-- Logs begin at Sat 2021-11-13 06:48:04 UTC, end at Sat 2021-11-13 08:07:53 UTC. -- Nov 13 07:39:11.067527 dv-cinder-817832-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 13 07:39:11.074871 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 13 07:39:11 2021] *** Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: nodename: dv-cinder-817832-1-iscsi Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: machine: x86_64 Nov 13 07:39:11.076921 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: clock source: unix Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: pcre jit disabled Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: detected number of CPU cores: 4 Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: current working directory: / Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: detected binary path: /usr/bin/uwsgi-core Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: your processes number limit is 47680 Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: your memory page size is 4096 bytes Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: detected max file descriptor number: 2048 Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: lock engine: pthread robust mutexes Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: thunder lock: enabled Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 13 07:39:11.077347 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 13 07:39:11.118328 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: Python main interpreter initialized at 0x5580e10459c0 Nov 13 07:39:11.118328 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: python threads support enabled Nov 13 07:39:11.118328 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: your server socket listen backlog is limited to 100 connections Nov 13 07:39:11.118328 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: your mercy for graceful operations on workers is 90 seconds Nov 13 07:39:11.118759 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: mapped 403077 bytes (393 KB) for 2 cores Nov 13 07:39:11.118841 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: *** Operational MODE: preforking *** Nov 13 07:39:11.119134 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: *** uWSGI is running in multiple interpreter mode *** Nov 13 07:39:11.119134 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: spawned uWSGI master process (pid: 82918) Nov 13 07:39:11.119334 dv-cinder-817832-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 13 07:39:11.120713 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: spawned uWSGI worker 1 (pid: 82919, cores: 1) Nov 13 07:39:11.120713 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: spawned uWSGI worker 2 (pid: 82920, cores: 1) Nov 13 07:39:11.120713 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 13 07:39:15.153616 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 13 07:39:15.154365 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 13 07:39:15.154365 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 13 07:39:15.154535 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 13 07:39:15.154935 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 13 07:39:15.155015 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 13 07:39:15.155083 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 13 07:39:15.155270 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 13 07:39:15.155378 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.155630 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 13 07:39:15.155735 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.155890 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 13 07:39:15.155984 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156262 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156364 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156578 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156667 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156892 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.156980 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157221 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157320 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157525 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157611 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157844 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.157938 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158160 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158248 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158465 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158551 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158759 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.158850 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159075 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159164 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159409 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817832-1-iscsi {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159546 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159680 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159784 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.159998 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160085 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160304 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160396 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817832-1-iscsi {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160617 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160706 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.160920 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161006 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161228 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161323 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161528 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161616 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.161835 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162018 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162157 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162457 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162595 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162788 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.162982 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163095 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163293 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163403 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163598 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163719 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.163916 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164034 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164252 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164357 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164566 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164872 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.164959 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165190 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165342 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165499 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165631 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817832-1-iscsi {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165809 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.165897 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166116 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166203 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166422 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166507 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817832-1-iscsi {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166753 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.166845 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167066 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167167 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167376 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167496 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167748 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.167835 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168065 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168160 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168371 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168473 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168689 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.168781 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169004 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169091 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169307 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169394 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169621 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169715 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.169945 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170034 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170255 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170342 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170562 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170657 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170891 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.170992 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171194 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171279 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171495 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171617 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171744 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.171843 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172049 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172137 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172368 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172464 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172629 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172714 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.172937 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173039 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173228 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173317 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173478 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173637 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173793 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.173889 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174110 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174200 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174360 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174451 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174703 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.174806 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175024 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175111 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175327 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175422 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175633 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175732 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.175937 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176032 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176241 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176329 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176545 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176640 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176852 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.176939 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177159 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177245 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177467 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177554 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177769 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.177864 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178083 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178174 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178406 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178494 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178722 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.178813 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179032 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179118 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179369 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179459 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179673 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179759 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.179977 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180070 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180292 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180380 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180609 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180695 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.180914 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181009 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181217 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181352 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181524 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181612 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181832 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.181930 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182139 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182235 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182434 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182520 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182728 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.182833 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183003 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183092 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183308 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183395 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183623 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183762 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.183923 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184009 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184227 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184315 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184529 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184626 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184825 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.184913 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.185127 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.185213 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.185431 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186063 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186253 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186345 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186560 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186646 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186889 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.186980 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187190 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187288 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187494 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187581 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187799 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.187893 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188097 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188183 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188401 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188488 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188707 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.188795 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189008 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189101 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189310 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189403 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189616 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189752 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.189930 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190022 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190230 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190338 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190529 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190624 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190857 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.190958 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191175 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191271 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191476 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191579 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191773 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.191870 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192087 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192175 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192389 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192477 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192689 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.192783 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193004 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193092 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193297 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193385 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193600 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193688 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.193917 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194097 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194220 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194315 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194521 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194611 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.194847 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195020 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195163 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195301 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195436 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195570 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195711 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195854 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.195989 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196123 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196275 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196417 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196552 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196693 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196836 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.196979 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197152 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197290 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197455 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197605 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197763 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.197899 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198063 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198210 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198375 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198513 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198701 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.198793 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.199008 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.199094 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.199329 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:39:15.199419 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.199660 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.199754 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.199988 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200089 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200308 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200397 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200622 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200707 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.200927 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.201012 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.201808 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.201915 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202135 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202231 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202447 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202542 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202776 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.202866 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203086 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203184 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203402 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203506 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203714 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.203801 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204028 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204125 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204337 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204436 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204648 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204735 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.204964 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205050 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205272 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205372 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205587 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205673 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205906 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.205999 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206215 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206309 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206518 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206603 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206872 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.206960 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207198 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207303 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207506 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207592 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207835 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.207923 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208144 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208233 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208462 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208549 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208775 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.208863 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209087 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209181 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209396 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209482 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209709 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.209797 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210021 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210116 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210334 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210428 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210648 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210792 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.210987 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211083 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211292 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211380 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211597 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211696 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211903 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.211990 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212212 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212299 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212515 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212615 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212821 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.212913 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213134 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213220 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213436 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213531 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213754 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.213840 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214058 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214152 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214367 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214467 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214691 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.214783 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215002 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215099 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215316 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215412 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215624 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215711 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.215927 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216013 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216241 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216375 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216548 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216636 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216887 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.216974 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217210 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217302 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217517 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217611 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217820 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.217906 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218126 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218214 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218439 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218527 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218770 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.218859 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219084 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219173 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219393 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219478 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219705 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.219800 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220029 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220116 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220346 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220432 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220647 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220742 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.220971 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221065 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221296 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221385 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221600 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221697 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221899 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.221985 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222207 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222330 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222509 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222605 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222834 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.222934 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223140 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223227 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223448 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223549 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223752 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.223840 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224053 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224191 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224355 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224444 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224657 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224752 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.224959 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225053 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225261 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225349 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225569 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225658 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225866 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.225952 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226168 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226268 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226469 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226558 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226800 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.226889 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.227365 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.227454 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.227671 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.227760 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228014 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228101 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228325 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228412 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228644 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228730 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.228972 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229067 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229289 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229377 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229598 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229685 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.229908 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230003 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230218 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230312 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230530 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230626 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.230868 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231010 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231185 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231273 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231501 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231586 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231808 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.231903 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232129 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232222 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232461 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232548 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232775 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.232877 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233076 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233163 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233387 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233475 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233695 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.233784 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234005 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234091 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234328 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234432 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234635 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234770 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.234979 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235067 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235293 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235387 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235601 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235697 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235905 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.235993 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236206 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236293 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236515 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236611 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236823 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.236916 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237123 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237209 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237431 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237520 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237736 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.237823 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238044 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238140 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238355 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238447 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238661 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238777 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.238995 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239099 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239303 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239390 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239631 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239727 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.239935 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240036 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240244 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240331 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240550 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240646 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240857 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.240954 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241161 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241252 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241464 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241553 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241770 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.241859 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242076 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242161 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242381 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242477 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242708 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.242800 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243016 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243102 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243328 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243428 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243634 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243723 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.243935 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244045 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244235 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244363 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244544 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244634 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244848 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.244934 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245154 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245242 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245470 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245559 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245784 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.245878 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246085 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246205 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246386 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246474 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246735 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.246824 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247044 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247144 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247344 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247431 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247645 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.247732 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.248447 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.248553 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.248767 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.248920 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249074 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249162 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249380 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249477 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249692 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.249779 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250011 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250109 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250313 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250412 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250621 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250754 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.250953 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251043 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251261 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251360 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251572 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251665 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251882 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.251968 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252189 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252277 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252499 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252602 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252807 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.252903 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253113 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253201 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253420 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253514 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253728 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.253815 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254034 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254121 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254343 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254472 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254650 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254776 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.254975 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255070 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255286 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255380 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255596 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255692 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.255903 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.256159 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.256253 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.256491 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.256586 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.256807 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257061 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257149 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257393 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257480 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257712 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.257807 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258032 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258121 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258352 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258439 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.258771 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259000 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259090 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259307 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259393 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259609 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259704 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259910 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.259999 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260218 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260303 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260519 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260606 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260823 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.260919 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261122 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261216 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261427 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261515 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261723 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.261810 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262025 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262113 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262327 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262459 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262627 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262777 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.262956 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263055 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263261 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263349 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263566 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263713 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.263905 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264062 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264227 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264315 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264536 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264623 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264840 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.264942 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265141 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265231 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265443 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265530 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265751 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.265848 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266055 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266143 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266361 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266450 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266721 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.266811 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267029 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267128 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267352 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267438 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267653 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267740 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.267973 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268072 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268281 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268368 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268581 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268667 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268888 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.268984 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269193 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269280 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269491 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269578 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269799 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.269895 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270105 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270191 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270407 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270493 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270731 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.270880 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271042 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271130 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271342 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271429 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271644 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271738 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.271943 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272030 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272244 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272341 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272544 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272638 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272847 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.272933 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273151 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273244 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273450 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273539 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273758 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.273844 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274064 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274150 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274363 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274449 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274686 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274775 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.274986 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275084 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275288 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275375 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275595 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275683 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.275898 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276163 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276268 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276358 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276504 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276592 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276809 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.276904 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277112 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277201 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277415 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277502 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277716 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.277813 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278022 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278115 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278325 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278412 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278626 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278746 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.278951 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.279040 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.279773 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.279869 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280076 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280176 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280378 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280465 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280686 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280773 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.280988 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281086 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281290 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281387 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281593 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281689 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281898 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.281996 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282204 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282301 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282510 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282598 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282880 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.282978 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283188 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283276 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283503 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283665 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283818 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.283918 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284122 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284212 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284437 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284534 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284750 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.284841 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285060 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285192 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285362 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285464 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285664 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285751 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.285983 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286071 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286297 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286396 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286608 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286744 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.286952 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287040 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287267 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287362 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287583 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287671 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287884 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.287972 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288192 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288282 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288503 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288602 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288816 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.288903 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289123 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289213 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289430 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289518 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289737 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.289823 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290044 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290137 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290354 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290440 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290768 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.290993 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291092 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291301 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291389 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291610 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291705 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.291918 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292008 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292220 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292309 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292529 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292625 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292838 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.292934 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293139 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293228 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293448 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293546 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293753 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.293841 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294057 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294143 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294356 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294451 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294661 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.294809 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295051 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295149 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295366 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295467 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295747 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.295842 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296058 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296158 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296368 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296469 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296681 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296828 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.296995 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297083 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297297 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297389 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297618 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297704 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.297937 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298024 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298246 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298341 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298602 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298709 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.298935 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299068 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299239 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299384 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299550 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299699 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.299873 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300007 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300176 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300314 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300480 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300629 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300782 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.300957 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301101 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301265 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301405 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301573 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301726 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.301880 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302139 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302230 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302451 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302538 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302835 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.302940 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303260 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303395 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303556 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303646 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303860 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.303955 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304179 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304266 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304498 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304586 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304821 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.304920 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305126 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305224 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305438 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305535 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305750 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.305840 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306058 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306153 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306380 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306471 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306718 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.306825 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307036 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307122 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307350 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307438 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307655 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307753 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.307973 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308059 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308290 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308392 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308599 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308686 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.308922 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309008 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309244 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309338 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309560 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309647 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309884 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.309973 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.310245 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.310341 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.310588 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.310709 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.310936 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311025 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311241 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311345 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311544 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311640 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311854 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.311952 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312158 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312249 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312462 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312552 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312784 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.312879 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313090 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313187 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313394 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313481 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313703 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.313791 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314011 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314109 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314312 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314401 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314615 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314734 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.314960 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315088 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315264 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315360 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315570 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315887 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.315975 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316189 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316319 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316514 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316610 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316818 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.316907 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317140 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317237 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317448 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317536 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317752 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.317842 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318054 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318150 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318357 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318452 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318710 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318814 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.318980 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319066 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319292 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319382 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319637 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319737 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.319942 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320038 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320261 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320349 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320589 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320683 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320910 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.320997 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321221 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321346 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321535 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321632 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321857 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.321956 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322161 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322250 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322463 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322560 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322800 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.322893 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323105 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323193 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323409 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323499 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323708 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.323799 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324014 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324113 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324315 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324405 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324616 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324704 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.324916 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325004 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325223 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325327 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325522 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325609 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325824 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.325910 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.326663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.326776 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.326988 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327077 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327292 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327394 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327594 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327690 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.327915 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328004 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328225 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328326 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328532 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328620 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328858 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.328953 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329171 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329269 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329496 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329582 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329804 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.329906 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330127 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330224 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330444 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330545 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330778 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.330869 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331094 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331185 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331412 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331499 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331723 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.331817 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332038 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332126 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332350 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332438 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332660 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332748 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.332975 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333062 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333288 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333383 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333595 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333681 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.333912 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.334106 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.334230 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.334435 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.334548 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.334796 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335102 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335190 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335410 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335514 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335719 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.335817 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336035 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336125 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336346 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336443 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336658 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336754 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.336965 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337052 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337273 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337362 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337581 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337679 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337889 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.337983 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338199 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338296 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338508 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338610 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338869 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.338958 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339188 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339277 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339503 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339593 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339816 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.339912 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340134 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340226 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340453 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340542 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340768 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.340864 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341085 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341181 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341402 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341502 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341773 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.341881 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342098 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342187 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342411 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342505 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342752 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.342857 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343067 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343169 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343384 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343475 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343695 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.343789 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344005 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344096 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344317 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344413 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344626 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344722 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.344936 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345032 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345251 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345384 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345568 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345665 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345875 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.345970 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.346186 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.346275 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.346498 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.346600 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.346878 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.347041 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.347194 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.347352 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.347513 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.347682 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348005 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348092 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348325 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348412 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348641 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348730 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.348954 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349041 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349268 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349364 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349571 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349661 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.349879 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350004 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350188 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350291 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350493 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350583 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350817 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.350920 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351128 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351218 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351437 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351525 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351736 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.351831 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.352302 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.352395 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.352606 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.352702 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.352910 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.353133 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.353230 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.353478 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.353582 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.353790 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354046 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354141 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354398 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354502 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354745 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.354857 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355053 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355140 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355374 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355471 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355677 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355772 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.355979 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356068 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356292 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356396 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356603 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356699 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356905 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.356994 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.357205 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.357294 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358040 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358137 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358349 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358437 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358648 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358798 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.358986 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359074 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359288 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359382 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359608 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359709 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359903 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.359998 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360203 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360331 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360505 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360596 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360818 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.360908 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361120 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361281 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361420 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361507 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361724 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.361814 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362026 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362122 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362328 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362421 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362626 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362733 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.362956 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363064 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363254 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363349 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363566 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363668 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363863 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.363959 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364168 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364259 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364469 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364558 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364773 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.364868 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365079 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365173 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365382 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365475 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365694 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.365788 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366001 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366091 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366310 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366397 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366619 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366726 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.366954 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367041 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367280 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367368 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367595 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367692 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.367908 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.368125 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.368257 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.368457 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.368578 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.368777 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369115 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369203 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369448 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369536 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369762 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.369852 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370068 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370157 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370372 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370469 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370710 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.370813 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371024 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371120 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371332 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371429 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371642 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371731 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.371950 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372047 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372257 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372359 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372566 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372667 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.372876 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373026 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373262 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373362 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373568 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373656 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373878 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.373966 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374193 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374281 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374506 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374593 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374842 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.374931 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375157 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375253 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375473 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375563 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375782 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.375877 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376089 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376179 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376397 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376493 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376705 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.376801 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377014 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377100 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377327 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377414 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377637 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377740 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.377940 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.378037 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.378436 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.378524 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.378782 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.378886 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379096 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379191 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379483 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379569 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379801 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.379898 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380129 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380215 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380452 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380541 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380769 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.380866 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381092 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381178 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381399 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381486 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381706 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.381796 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382014 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382102 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382323 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382418 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382657 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382783 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.382988 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383086 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383304 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383411 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383617 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383758 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.383941 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384030 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384252 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384349 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384566 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384660 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384887 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.384974 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385197 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385292 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385505 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385593 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385834 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.385920 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386144 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386241 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386456 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386544 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386796 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.386890 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387113 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387209 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387420 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387508 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387731 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.387820 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.388043 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.388132 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.388356 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.388444 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389183 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389279 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389510 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389600 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389834 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.389930 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390141 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390228 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390456 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390543 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390793 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.390893 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391111 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391282 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391419 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391507 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391730 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.391817 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392038 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392137 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392351 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392440 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392666 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392762 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.392976 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393072 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393290 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393380 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393608 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393697 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.393926 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394023 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394254 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394379 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394580 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394750 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.394935 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395068 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395265 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395493 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395636 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395825 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.395953 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.396069 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 13 07:39:15.396304 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.396634 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:39:15.396882 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 13 07:39:15.429918 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_db.sqlalchemy.engines [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.430870 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.672899 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.context [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b8a17e1-4a8c-41e8-b833-be40a715238f(cell1) {{(pid=82919) load_cells /opt/stack/nova/nova/context.py:465}} Nov 13 07:39:15.674641 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.context [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b8a17e1-4a8c-41e8-b833-be40a715238f(cell1) {{(pid=82920) load_cells /opt/stack/nova/nova/context.py:465}} Nov 13 07:39:15.677137 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:39:15.678831 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:39:15.678928 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_concurrency.lockutils [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:39:15.679644 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:39:15.680599 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_concurrency.lockutils [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:39:15.681421 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_concurrency.lockutils [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:39:15.681607 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:39:15.683446 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_concurrency.lockutils [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:39:15.713134 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_db.sqlalchemy.engines [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.715724 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.716014 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_db.sqlalchemy.engines [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.716532 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.746956 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_db.sqlalchemy.engines [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.747874 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:39:15.973075 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO keyring.backend [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Loading KWallet Nov 13 07:39:15.982397 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO keyring.backend [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Loading SecretService Nov 13 07:39:15.986284 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO keyring.backend [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Loading Windows Nov 13 07:39:15.988139 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO keyring.backend [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Loading chainer Nov 13 07:39:15.988933 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO keyring.backend [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Loading macOS Nov 13 07:39:15.993755 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO keyring.backend [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Loading KWallet Nov 13 07:39:16.003182 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO keyring.backend [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Loading SecretService Nov 13 07:39:16.007088 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO keyring.backend [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Loading Windows Nov 13 07:39:16.008930 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO keyring.backend [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Loading chainer Nov 13 07:39:16.009726 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO keyring.backend [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Loading macOS Nov 13 07:39:16.333235 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: WARNING keystonemiddleware.auth_token [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:39:16.341137 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: WARNING keystonemiddleware.auth_token [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:39:16.350617 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: WARNING keystonemiddleware.auth_token [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:39:16.358101 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: WARNING keystonemiddleware.auth_token [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:39:16.551791 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: WARNING keystonemiddleware.auth_token [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:39:16.556907 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: WARNING keystonemiddleware.auth_token [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:39:16.562213 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5580e10459c0 pid: 82919 (default app) Nov 13 07:39:16.564307 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:39:16.565831 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-1d4776a7-c08c-4160-9b04-0692118e744b None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001660 Nov 13 07:39:16.565831 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Sat Nov 13 07:39:16 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:39:16.569733 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: WARNING keystonemiddleware.auth_token [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:39:16.574891 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: WARNING keystonemiddleware.auth_token [None req-2f8e92a9-b650-4d92-b112-4a43cb12450c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:39:16.580079 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5580e10459c0 pid: 82920 (default app) Nov 13 07:40:36.490503 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-4a332713-d3df-4453-b4c5-7ec9487cbaae admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:36.513663 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-4a332713-d3df-4453-b4c5-7ec9487cbaae admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.455814 Nov 13 07:40:36.514224 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 2/2] 10.222.0.32 () {58 vars in 1159 bytes} [Sat Nov 13 07:40:36 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:38.887758 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-e2d65801-1805-4a80-a080-acfe5d30e321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:38.910612 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:40:38.910612 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: warnings.warn(msg) Nov 13 07:40:38.984603 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-e2d65801-1805-4a80-a080-acfe5d30e321 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.412333 Nov 13 07:40:38.985125 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 1/3] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:38 2021] POST /compute/v2.1/flavors => generated 367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:39.000955 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-724fbfa2-57a1-4bd2-b274-6bf27257c6b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:39.007838 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:40:39.007838 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:40:39.112870 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-724fbfa2-57a1-4bd2-b274-6bf27257c6b4 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.121174 Nov 13 07:40:39.113411 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 3/4] 10.222.0.32 () {62 vars in 1245 bytes} [Sat Nov 13 07:40:38 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:39.128355 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-7fcfa39d-e680-4c80-997c-5765728e6f9f admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:39.149977 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-7fcfa39d-e680-4c80-997c-5765728e6f9f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030883 Nov 13 07:40:39.150500 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 2/5] 10.222.0.32 () {58 vars in 1192 bytes} [Sat Nov 13 07:40:39 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:41.269806 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-c2189487-cbda-4f01-adfe-6c870b4ce64b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:41.298662 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:40:41.298662 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:40:41.421658 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-c2189487-cbda-4f01-adfe-6c870b4ce64b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.230591 Nov 13 07:40:41.422170 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 4/6] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:41 2021] POST /compute/v2.1/flavors => generated 364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:41.437385 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-d590e6eb-3e08-4922-b769-202812242cd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:41.443501 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:40:41.443501 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: warnings.warn(msg) Nov 13 07:40:41.745805 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-d590e6eb-3e08-4922-b769-202812242cd0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.317216 Nov 13 07:40:41.746306 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 3/7] 10.222.0.32 () {62 vars in 1245 bytes} [Sat Nov 13 07:40:41 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:41.761147 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-4c29a2c4-6853-4542-ba7a-7e681e54d5a4 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:41.891058 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-4c29a2c4-6853-4542-ba7a-7e681e54d5a4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.138170 Nov 13 07:40:41.891619 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1192 bytes} [Sat Nov 13 07:40:41 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:40:44.033049 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-bc142cf9-1f2e-46e2-9092-d74a4be98eeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:44.187173 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-bc142cf9-1f2e-46e2-9092-d74a4be98eeb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.230844 Nov 13 07:40:44.187661 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 4/9] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:43 2021] POST /compute/v2.1/flavors => generated 364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:44.202362 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-ce05fd91-b808-403f-86b5-ee1f7aef11e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:44.315992 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-ce05fd91-b808-403f-86b5-ee1f7aef11e7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.121987 Nov 13 07:40:44.316559 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 6/10] 10.222.0.32 () {62 vars in 1245 bytes} [Sat Nov 13 07:40:44 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:44.330581 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-119fe2dd-9dcd-476d-810f-5b92760981ca admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:44.461914 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-119fe2dd-9dcd-476d-810f-5b92760981ca admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.139501 Nov 13 07:40:44.462381 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 5/11] 10.222.0.32 () {58 vars in 1192 bytes} [Sat Nov 13 07:40:44 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:46.594206 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-06433086-4fae-43ea-82df-6220ff481356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:46.682453 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-06433086-4fae-43ea-82df-6220ff481356 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.166134 Nov 13 07:40:46.682982 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 7/12] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:46 2021] POST /compute/v2.1/flavors => generated 364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:46.697781 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-b1e80bde-39f5-4a8e-bcbb-840c2155627a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:46.779515 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-b1e80bde-39f5-4a8e-bcbb-840c2155627a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.090184 Nov 13 07:40:46.780079 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 6/13] 10.222.0.32 () {62 vars in 1245 bytes} [Sat Nov 13 07:40:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:40:46.794321 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-f38ed615-1601-40fb-99d6-d685d8bef2a9 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:46.813519 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-f38ed615-1601-40fb-99d6-d685d8bef2a9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027718 Nov 13 07:40:46.814023 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 8/14] 10.222.0.32 () {58 vars in 1192 bytes} [Sat Nov 13 07:40:46 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:48.931029 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-ee79c905-5e54-4ae7-87b0-e221573d2e8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:49.048186 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-ee79c905-5e54-4ae7-87b0-e221573d2e8d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.194776 Nov 13 07:40:49.048734 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 7/15] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:48 2021] POST /compute/v2.1/flavors => generated 364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:49.064544 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-7bc66663-c732-4db9-bc4e-6f846d893669 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:49.156595 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-7bc66663-c732-4db9-bc4e-6f846d893669 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.101555 Nov 13 07:40:49.157147 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 9/16] 10.222.0.32 () {62 vars in 1245 bytes} [Sat Nov 13 07:40:49 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:40:49.171821 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-d3cf2728-44ae-43a5-a757-49fcabd5390f admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:49.190937 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-d3cf2728-44ae-43a5-a757-49fcabd5390f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028200 Nov 13 07:40:49.191471 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 8/17] 10.222.0.32 () {58 vars in 1192 bytes} [Sat Nov 13 07:40:49 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:51.335327 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-d2f39541-d1f0-4f84-91b3-0d309dc0e361 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:51.353919 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-d2f39541-d1f0-4f84-91b3-0d309dc0e361 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.101464 Nov 13 07:40:51.354456 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 10/18] 10.222.0.32 () {58 vars in 1159 bytes} [Sat Nov 13 07:40:51 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:40:53.492926 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-722c8b88-e336-4735-a31d-65be8f0ca045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:53.574664 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-722c8b88-e336-4735-a31d-65be8f0ca045 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.164860 Nov 13 07:40:53.575497 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 9/19] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:53 2021] POST /compute/v2.1/flavors => generated 362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:53.591775 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-fff7176e-fa70-4d65-95d6-3aad6917283d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:53.687422 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-fff7176e-fa70-4d65-95d6-3aad6917283d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.105482 Nov 13 07:40:53.687982 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 11/20] 10.222.0.32 () {62 vars in 1242 bytes} [Sat Nov 13 07:40:53 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:53.701984 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-eeec9a4c-2dad-4ab4-a475-fb148fe9f624 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:53.721245 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-eeec9a4c-2dad-4ab4-a475-fb148fe9f624 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027640 Nov 13 07:40:53.721769 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 10/21] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Nov 13 07:40:53 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:55.844915 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-c86b51b8-4eba-40a3-bb52-7e4550516e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:55.968682 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-c86b51b8-4eba-40a3-bb52-7e4550516e59 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.200990 Nov 13 07:40:55.969259 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 12/22] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:55 2021] POST /compute/v2.1/flavors => generated 365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:40:55.983966 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-613f466c-ff50-4887-bb61-0a5d61c1bbc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:56.070255 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-613f466c-ff50-4887-bb61-0a5d61c1bbc1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.094800 Nov 13 07:40:56.070825 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 11/23] 10.222.0.32 () {62 vars in 1242 bytes} [Sat Nov 13 07:40:55 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:56.085273 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a13c909d-d35d-4ac9-9fb6-abac4d68c2fc admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:56.104977 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a13c909d-d35d-4ac9-9fb6-abac4d68c2fc admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028081 Nov 13 07:40:56.107088 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 13/24] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Nov 13 07:40:56 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:58.270427 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-8fc2c083-152a-4ef0-addb-5b075d351b3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:58.375754 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-8fc2c083-152a-4ef0-addb-5b075d351b3a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.189439 Nov 13 07:40:58.376237 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 12/25] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:40:58 2021] POST /compute/v2.1/flavors => generated 366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:40:58.392137 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-9b264162-849a-4927-a342-32fcda56d166 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:40:58.522601 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-9b264162-849a-4927-a342-32fcda56d166 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.140057 Nov 13 07:40:58.523203 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 14/26] 10.222.0.32 () {62 vars in 1242 bytes} [Sat Nov 13 07:40:58 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:40:58.537274 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-74be2d00-2066-410c-9bee-d9292bcc6868 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:40:58.557211 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-74be2d00-2066-410c-9bee-d9292bcc6868 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028377 Nov 13 07:40:58.557760 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 13/27] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Nov 13 07:40:58 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:41:00.677026 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-92f05e96-f740-4258-96d6-d47233cd6883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:41:00.791817 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-92f05e96-f740-4258-96d6-d47233cd6883 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.192818 Nov 13 07:41:00.792371 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 15/28] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:41:00 2021] POST /compute/v2.1/flavors => generated 365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:41:00.806970 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-a5d4723d-aafe-4f13-b305-f42cb6e469f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:41:00.956466 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-a5d4723d-aafe-4f13-b305-f42cb6e469f7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.157892 Nov 13 07:41:00.957030 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 14/29] 10.222.0.32 () {62 vars in 1242 bytes} [Sat Nov 13 07:41:00 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:41:00.971550 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-5a03520b-e1b5-448d-a8c4-44ab9d03b606 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:41:00.990803 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-5a03520b-e1b5-448d-a8c4-44ab9d03b606 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028186 Nov 13 07:41:00.991320 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 16/30] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Nov 13 07:41:00 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:41:03.120553 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-079ae19d-8383-40ce-857f-6cecba9403e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:41:03.203208 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-079ae19d-8383-40ce-857f-6cecba9403e3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.160682 Nov 13 07:41:03.203680 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 15/31] 10.222.0.32 () {62 vars in 1192 bytes} [Sat Nov 13 07:41:03 2021] POST /compute/v2.1/flavors => generated 368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:41:03.218648 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-0c7e7053-0ee9-45a8-8609-4854d5cc5e01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:41:03.335703 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-0c7e7053-0ee9-45a8-8609-4854d5cc5e01 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.125144 Nov 13 07:41:03.336788 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 17/32] 10.222.0.32 () {62 vars in 1242 bytes} [Sat Nov 13 07:41:03 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:41:03.350899 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-d6b89aec-b1d0-4b2e-8a66-65961d392493 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:41:03.370442 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-d6b89aec-b1d0-4b2e-8a66-65961d392493 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027956 Nov 13 07:41:03.371637 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 16/33] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Nov 13 07:41:03 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:42:12.211441 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-0c8c9302-9a5d-4dd3-8b05-10e9218e6a03 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:12.233811 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-0c8c9302-9a5d-4dd3-8b05-10e9218e6a03 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.098635 Nov 13 07:42:12.234348 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 18/34] 10.222.0.32 () {58 vars in 1159 bytes} [Sat Nov 13 07:42:12 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:42:13.629899 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-d6b89aec-b1d0-4b2e-8a66-65961d392493 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:13.630937 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-d6b89aec-b1d0-4b2e-8a66-65961d392493 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Nov 13 07:42:13.631337 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 17/35] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:13.842996 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-37acc79b-1bf5-48af-bab3-538bf2a77ce3 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:13.855227 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.wsgi [None req-37acc79b-1bf5-48af-bab3-538bf2a77ce3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 13 07:42:13.856353 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-37acc79b-1bf5-48af-bab3-538bf2a77ce3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:13.857122 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-37acc79b-1bf5-48af-bab3-538bf2a77ce3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.092178 Nov 13 07:42:13.857615 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 19/36] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Nov 13 07:42:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 13 07:42:13.872062 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-ccd54cf5-b025-48d1-b130-8ef8f4997b88 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:13.893245 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-ccd54cf5-b025-48d1-b130-8ef8f4997b88 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.030133 Nov 13 07:42:13.893761 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:42:13.908007 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-8255cd84-8bc5-4116-a06d-ea1f09a10766 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:13.927668 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-8255cd84-8bc5-4116-a06d-ea1f09a10766 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028092 Nov 13 07:42:13.928172 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 20/38] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:42:13.942229 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-6bd4f9e3-4a32-4939-a301-a9bed61e9f3c admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:13.954000 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.wsgi [None req-6bd4f9e3-4a32-4939-a301-a9bed61e9f3c admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 13 07:42:13.954563 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-6bd4f9e3-4a32-4939-a301-a9bed61e9f3c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:13.955361 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-6bd4f9e3-4a32-4939-a301-a9bed61e9f3c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.021784 Nov 13 07:42:13.955847 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Nov 13 07:42:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 13 07:42:15.418160 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-8255cd84-8bc5-4116-a06d-ea1f09a10766 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:15.419174 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-8255cd84-8bc5-4116-a06d-ea1f09a10766 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 13 07:42:15.419570 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 21/40] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:15.636785 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-a5a06cc3-e9d1-4e82-b574-395ad6b839d0 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:15.648491 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.wsgi [None req-a5a06cc3-e9d1-4e82-b574-395ad6b839d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 13 07:42:15.649056 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-a5a06cc3-e9d1-4e82-b574-395ad6b839d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:15.649831 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-a5a06cc3-e9d1-4e82-b574-395ad6b839d0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.097841 Nov 13 07:42:15.650332 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Nov 13 07:42:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 13 07:42:15.664374 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-88e37786-5c84-42d9-97b9-2a9c6f516834 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:15.684793 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-88e37786-5c84-42d9-97b9-2a9c6f516834 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028787 Nov 13 07:42:15.685301 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:42:15.699393 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-4ce7a276-ec01-4966-934a-538e5b891132 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:15.719004 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-4ce7a276-ec01-4966-934a-538e5b891132 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028046 Nov 13 07:42:15.719521 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 21/43] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:42:15.734023 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-dba91eb6-fb68-490c-b5d7-eeb31d20b7f0 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:15.745692 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.wsgi [None req-dba91eb6-fb68-490c-b5d7-eeb31d20b7f0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 13 07:42:15.746303 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-dba91eb6-fb68-490c-b5d7-eeb31d20b7f0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:15.747084 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-dba91eb6-fb68-490c-b5d7-eeb31d20b7f0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.022166 Nov 13 07:42:15.747563 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Nov 13 07:42:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 13 07:42:17.075026 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-4ce7a276-ec01-4966-934a-538e5b891132 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:17.076017 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-4ce7a276-ec01-4966-934a-538e5b891132 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 13 07:42:17.076411 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 22/45] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:17.293145 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-00e63940-df9b-4950-8838-5dccb242e1ac admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:17.305233 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.wsgi [None req-00e63940-df9b-4950-8838-5dccb242e1ac admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 13 07:42:17.305802 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-00e63940-df9b-4950-8838-5dccb242e1ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:17.306574 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-00e63940-df9b-4950-8838-5dccb242e1ac admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.091948 Nov 13 07:42:17.307118 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:42:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 13 07:42:17.321455 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-bb75e62b-cacc-4b6f-a1ad-383e9c41df1c admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:17.341356 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-bb75e62b-cacc-4b6f-a1ad-383e9c41df1c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028145 Nov 13 07:42:17.341896 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:42:17.356146 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:17.375876 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028257 Nov 13 07:42:17.376400 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 25/48] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Nov 13 07:42:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:42:17.390711 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-9312e13f-3fa3-4047-b4ed-5b49a54cbd0f admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:17.402784 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.wsgi [None req-9312e13f-3fa3-4047-b4ed-5b49a54cbd0f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 13 07:42:17.403477 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-9312e13f-3fa3-4047-b4ed-5b49a54cbd0f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:42:17.404269 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-9312e13f-3fa3-4047-b4ed-5b49a54cbd0f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.022331 Nov 13 07:42:17.404768 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:42:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 13 07:42:18.725420 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:18.726403 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 13 07:42:18.726830 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 26/50] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:18.938385 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-a7e07216-faa0-4da0-8541-631fcd601238 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:42:19.032067 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-a7e07216-faa0-4da0-8541-631fcd601238 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.170262 Nov 13 07:42:19.032601 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 25/51] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Nov 13 07:42:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:42:20.352302 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:20.353296 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Nov 13 07:42:20.353693 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 27/52] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:20.563089 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-e0f39a48-8943-4f8a-8d10-ce58fe48ca72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:42:20.682543 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-e0f39a48-8943-4f8a-8d10-ce58fe48ca72 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.196831 Nov 13 07:42:20.683106 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 26/53] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Nov 13 07:42:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:42:22.013695 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:22.014748 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Nov 13 07:42:22.015157 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 28/54] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:22.226119 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-b29c0605-a045-4f9d-9ed8-83f9c7b3a3ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:42:22.323152 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-b29c0605-a045-4f9d-9ed8-83f9c7b3a3ba admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.174447 Nov 13 07:42:22.323684 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 27/55] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Nov 13 07:42:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:42:23.656186 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:23.657171 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Nov 13 07:42:23.657565 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 29/56] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:23.870704 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-2ee60e27-2be4-4222-be9b-97b06edd20aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:42:23.996849 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-2ee60e27-2be4-4222-be9b-97b06edd20aa admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.205243 Nov 13 07:42:23.997383 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 28/57] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Nov 13 07:42:23 2021] POST /compute/v2.1/flavors => generated 409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:42:25.319615 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:25.320589 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001378 Nov 13 07:42:25.320980 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 30/58] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:42:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:42:25.530192 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-65621ea9-c3d9-45b9-b531-e18f9656e042 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:42:25.560555 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-65621ea9-c3d9-45b9-b531-e18f9656e042 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.107491 Nov 13 07:42:25.561094 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 29/59] 10.222.0.32 () {60 vars in 1202 bytes} [Sat Nov 13 07:42:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:43:03.328287 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:43:03.329275 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a3ec3854-d3f6-45bb-8238-d1187848f182 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Nov 13 07:43:03.329668 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 31/60] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:43:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:43:03.542948 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:43:03.572268 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.107815 Nov 13 07:43:03.573332 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 30/61] 10.222.0.32 () {60 vars in 1202 bytes} [Sat Nov 13 07:43:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:44:26.084206 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-b19bc5b7-4ca1-44c9-bd1a-42b1164eec24 tempest-verify_tempest_config-1233534129 tempest-verify_tempest_config-1233534129-project] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:44:26.091267 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-b19bc5b7-4ca1-44c9-bd1a-42b1164eec24 tempest-verify_tempest_config-1233534129 tempest-verify_tempest_config-1233534129-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.143376 Nov 13 07:44:26.091789 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 32/62] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Nov 13 07:44:25 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:45:55.428671 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:45:55.429683 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 13 07:45:55.430078 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 31/63] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:45:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:45:55.712386 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:45:55.718142 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:45:55.718142 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:45:55.719661 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:45:55.720104 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:45:55.720892 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:45:55.721317 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:45:55.751563 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-3673e459-5ef0-43db-8971-ca0738528263 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.187429 Nov 13 07:45:55.752113 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:45:55 2021] GET /compute/v2.1/os-services => generated 791 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:45:57.099062 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:45:57.100062 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 13 07:45:57.103815 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 32/65] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:45:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:45:57.311975 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:45:57.318468 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:45:57.318468 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:45:57.319958 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:45:57.320398 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:45:57.321177 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:45:57.321598 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:45:57.349655 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-c0f77e16-2b5f-4858-a790-0fb5234fd5f5 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.114711 Nov 13 07:45:57.350212 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:45:57 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:46:09.104019 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:46:09.105005 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 13 07:46:09.105397 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 33/67] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:46:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:46:09.317804 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:46:09.323481 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:46:09.323481 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:46:09.324922 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:46:09.325357 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:46:09.326124 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:46:09.326541 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:46:09.351419 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-97f804f2-80fe-45c6-bd3d-87530006e521 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.110586 Nov 13 07:46:09.351947 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:46:09 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:46:10.692367 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: DEBUG nova.api.openstack.wsgi [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] Calling method '>' {{(pid=82920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:46:10.694132 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: INFO nova.api.openstack.requestlog [None req-98dd3dde-d5c9-44ea-aa4c-ff0b58b75ae1 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Nov 13 07:46:10.694538 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: [pid: 82920|app: 0|req: 34/69] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Nov 13 07:46:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:46:10.912521 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG nova.api.openstack.wsgi [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] Calling method '>' {{(pid=82919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:46:10.918299 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:46:10.918299 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: warnings.warn(msg) Nov 13 07:46:10.919831 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:46:10.920272 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:46:10.921060 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:46:10.921486 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: DEBUG oslo_concurrency.lockutils [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:46:10.947692 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: INFO nova.api.openstack.requestlog [None req-a4cad91b-294e-413d-926b-85d479c6eabc admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.118651 Nov 13 07:46:10.948231 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: [pid: 82919|app: 0|req: 36/70] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Nov 13 07:46:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:47:06.136654 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: Sat Nov 13 07:47:06 2021 - graceful shutdown triggered... Nov 13 07:47:06.136776 dv-cinder-817832-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 13 07:47:06.137743 dv-cinder-817832-1-iscsi devstack@n-api.service[82919]: Gracefully killing worker 1 (pid: 82919)... Nov 13 07:47:06.138120 dv-cinder-817832-1-iscsi devstack@n-api.service[82920]: Gracefully killing worker 2 (pid: 82920)... Nov 13 07:47:07.138792 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: worker 1 buried after 1 seconds Nov 13 07:47:07.138792 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: worker 2 buried after 1 seconds Nov 13 07:47:07.138792 dv-cinder-817832-1-iscsi devstack@n-api.service[82918]: goodbye to uWSGI. Nov 13 07:47:07.140376 dv-cinder-817832-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 13 07:47:07.140933 dv-cinder-817832-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 13 07:47:07.144289 dv-cinder-817832-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 13 07:47:07.155228 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 13 07:47:07 2021] *** Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: nodename: dv-cinder-817832-1-iscsi Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: machine: x86_64 Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: clock source: unix Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: pcre jit disabled Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: detected number of CPU cores: 4 Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: current working directory: / Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: detected binary path: /usr/bin/uwsgi-core Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: your processes number limit is 47680 Nov 13 07:47:07.157201 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: your memory page size is 4096 bytes Nov 13 07:47:07.157965 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: detected max file descriptor number: 2048 Nov 13 07:47:07.157965 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: lock engine: pthread robust mutexes Nov 13 07:47:07.157965 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: thunder lock: enabled Nov 13 07:47:07.157965 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 13 07:47:07.157965 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 13 07:47:07.197447 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: Python main interpreter initialized at 0x5628efa349c0 Nov 13 07:47:07.197447 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: python threads support enabled Nov 13 07:47:07.197447 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: your server socket listen backlog is limited to 100 connections Nov 13 07:47:07.197447 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: your mercy for graceful operations on workers is 90 seconds Nov 13 07:47:07.197849 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: mapped 403077 bytes (393 KB) for 2 cores Nov 13 07:47:07.197849 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: *** Operational MODE: preforking *** Nov 13 07:47:07.198067 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: *** uWSGI is running in multiple interpreter mode *** Nov 13 07:47:07.198067 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: spawned uWSGI master process (pid: 97376) Nov 13 07:47:07.198279 dv-cinder-817832-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 13 07:47:07.215186 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: spawned uWSGI worker 1 (pid: 97388, cores: 1) Nov 13 07:47:07.215186 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: spawned uWSGI worker 2 (pid: 97389, cores: 1) Nov 13 07:47:07.215186 dv-cinder-817832-1-iscsi devstack@n-api.service[97376]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 13 07:47:11.208889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 13 07:47:11.209499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 13 07:47:11.209608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 13 07:47:11.210010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 13 07:47:11.210267 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 13 07:47:11.210720 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.211052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.211425 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.211762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.212082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.212403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.212738 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.213055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.213376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.213752 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.214126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.214391 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.214724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.215109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817832-1-iscsi {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.215485 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.215813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.216111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.216449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.216740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.217060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.217364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.217861 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.218300 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.218610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.219054 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.219775 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.220116 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.220512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.221477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.221797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.222236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.222510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.222902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817832-1-iscsi {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.223229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.223589 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.223907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.224321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.224634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.224948 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.225272 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.225595 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.225919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.226236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.226557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.226902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.227220 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.227521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.227829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.228154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.228459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.228763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.229067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.229317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.229625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.229945 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.230265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.230588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.230865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.231118 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.231437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.231757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.232066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.232640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.232950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.233264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.233568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.233874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.234183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.234490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.234841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.235160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.235483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.235793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.236114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.236230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 13 07:47:11.236675 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 13 07:47:11.237281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.237281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.237425 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 13 07:47:11.237585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.237806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 13 07:47:11.237924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.238073 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 13 07:47:11.238243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.238472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.238581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.238831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.238941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239817 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.239939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.240848 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241404 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.241907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817832-1-iscsi {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.242972 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243324 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.243882 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244391 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.244798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.245992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.246210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.246352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.246528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.246771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.246892 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247020 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247319 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.247927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.248865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817832-1-iscsi {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.249043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.249163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.249365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.249492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.250660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.251759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.251862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.251959 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.252055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.252148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.252248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.252342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253158 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253464 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253551 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253821 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.253915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254085 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254343 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.254602 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255572 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.255936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256203 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256398 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256582 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256815 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.256944 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.257077 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.257259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.257363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.257600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.257700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.257935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.258036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.258262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.258360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.258580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.258702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.258923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.259026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.259240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.259331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.259555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.259652 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.259874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.260005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.260182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.260336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.260496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.260597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.260807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.260900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.261124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.261217 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.261439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.261531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.261753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.261916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.262072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.262163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.262403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.262496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.262756 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.262866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.263063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.263155 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.263385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.263487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.263706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.263801 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.264025 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.264115 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.264353 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.264460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.264671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.264769 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.264985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.265090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.265296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.265409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.265615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.265715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.265940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.266044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.266267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.266369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.266577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.266691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.266860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.266996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.267170 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.267314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.267481 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.267635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.267806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.267989 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.268145 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.268290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.268459 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.268603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.268773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.268941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.269078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.269258 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.269390 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.269575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.269702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.269885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.270016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.270193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.270359 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.270505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.270727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.270825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.270955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.271135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.271270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.271458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.271583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.271786 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.271881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.272095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.272189 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.272427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.272527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.272734 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.272829 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.273046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.273138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.273358 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.273451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.273669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.273774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.273983 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.274082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.274295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.274395 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.274601 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.274716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.274950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.275078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.275301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.275406 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.275559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.275653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.275882 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.275991 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.276187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.276290 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.276493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.276594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.276816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.276907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.277129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.277248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.277443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.277538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.277768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.277868 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.278277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.278384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.278459 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.278529 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.278714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.279023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.279328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.279538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.279635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.279885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.280041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.280205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.280349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.280534 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.280644 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.280935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.281044 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.281205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.281350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.281491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.281632 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.281796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.281963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.282124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.282316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.282466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.282646 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 07:47:11.282831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.283024 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.283185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.283329 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.283477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.284279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.284443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.284596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.284753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.284923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285819 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.285967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286398 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286548 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.286934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287084 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287379 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287522 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.287956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.288845 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.289966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290397 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290717 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.290881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291350 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.291918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.292943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293084 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.293962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.294103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.294394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.294559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.294720 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.294927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295686 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.295977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.296882 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297617 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297776 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.297926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298068 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.298975 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.299127 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.299897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300626 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300769 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.300915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301058 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301681 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.301972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302114 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.302896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.303976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.304129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.304284 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.304576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.304722 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.304864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305302 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.305904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306054 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306639 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.306970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307550 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.307852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.308873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309021 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.309941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310098 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310250 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.310890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311844 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.311987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312423 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.312971 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.313868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.314918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315068 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315519 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315674 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.315973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316295 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316613 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.316927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317684 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.317986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318305 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318618 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318799 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.318949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319103 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.319977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320481 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.320923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.321070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.321232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.321405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.321630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.321809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322211 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322374 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.322906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323054 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323201 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.323972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.324129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.324284 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.324431 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.324588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.324878 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.325954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326764 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.326942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.327860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328007 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.328936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329395 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329552 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329792 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.329947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330096 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330406 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330562 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.330892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331347 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.331876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332666 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.332961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333429 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.333880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.334039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.334194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.334355 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.334511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.334826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.335185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.335344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.335511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.335673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.335823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336113 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336425 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.336886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337484 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337792 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.337938 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338091 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338251 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.338891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339039 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339509 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.339935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.340129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.340291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.340291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.340728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.340906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341675 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.341851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.342957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343104 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343413 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.343856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344628 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344782 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.344936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.345251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.345413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.345561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.345708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.345854 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.346009 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.346893 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347495 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.347947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348543 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.348869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349169 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349633 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.349781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350012 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350324 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.350970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.351934 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.352099 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.352323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.352510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.352745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.352898 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.353053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.353219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.353374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.353533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.353688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354739 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.354894 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.355842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.356121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.356276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.356425 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.356581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.356737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.357028 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.357192 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.357592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.357745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.357745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.358957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.359853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360837 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.360985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.361140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.361295 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.361450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.361597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.361803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.362547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.362726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.362976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363289 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363436 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363667 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363824 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.363980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.364883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365031 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365350 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365818 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.365966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.366114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.366269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.366424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.366585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.366841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367161 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.367935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368391 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.368862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369039 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.369955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.370109 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.370341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.370501 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.370663 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.370848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371003 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371158 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.371946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.372969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373215 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.373996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374289 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374806 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.374957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.375103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.375249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.375407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.375725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.375880 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376028 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376331 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376331 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376621 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.376935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.377213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.377424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.377582 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.377753 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.377753 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.378988 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.379318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.379488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.379662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.379888 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.380923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381225 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.381848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.382938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.383102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.383352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.383518 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.383667 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.383814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384672 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.384976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.385122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.385278 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.385433 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.385583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.385891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.386864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387699 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.387846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.388936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389096 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389252 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389252 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.389926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.390157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.390319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.390475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.390748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.390918 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391389 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.391977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392287 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392433 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.392909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.393167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.393346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.393589 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.393744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.393891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.394820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.395162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.395352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.395352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.395647 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.395647 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.396103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.396259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.396615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.396615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.396935 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397801 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.397957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398263 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398263 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.398879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399489 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399636 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.399951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.400318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.400480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.400631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.400953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.401110 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.401258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.401412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.401560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.401709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.404649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.404834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.404995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405165 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405789 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.405946 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.406262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.406419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.406576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.406785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.406965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407115 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407832 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.407997 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.408154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.408311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.408466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.409149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.409305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.409472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.409628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.409857 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.410065 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.410245 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.410488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.410488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.410856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411569 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.411890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412038 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412789 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.412936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413091 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413386 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413803 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.413965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.414114 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.414261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.414434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.414682 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.414918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415086 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.415916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416083 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416545 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.416997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.417159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.417324 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.417483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.417631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.417631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.418093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.418288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.418439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.418614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.418980 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419305 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419623 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.419933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.420949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.421115 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.421346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.421571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.421723 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.421871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.422880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423804 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.423951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.424106 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.424320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.424320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.425273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.425432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.425599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.425766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.425929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.426078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.426225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.426534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.426716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.426900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427355 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427659 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.427993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.428224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.428393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.428541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.428699 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.428855 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.429907 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430920 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.430991 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431076 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431159 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.431887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432345 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.432900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433141 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433371 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433489 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433730 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.433966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434076 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434824 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.434944 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.435941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436658 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.436796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437258 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437377 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.437957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438066 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.438579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439390 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.439864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.440976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.441878 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.442919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443145 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443256 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443256 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.443942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.444983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.445835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446456 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.446930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.447949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448068 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448068 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.448979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449406 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.449991 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450765 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.450927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451317 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451397 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451686 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451780 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.451939 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452022 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452838 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.452936 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453176 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453266 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453508 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.453921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.454169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.454251 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.454489 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.454583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.455957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.456920 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.457214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.457382 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.457541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.457698 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.457857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.458011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.458237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.458402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.458565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.458827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459031 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459810 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.459970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.460864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.461912 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.462095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.462254 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.462435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.462703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.462953 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463587 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.463898 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464047 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464203 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464669 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464817 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.464974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.465581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.466615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.466615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.466615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.467092 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.467463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.467790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.468122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.468455 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.468777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.469121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.469472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.469814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.470152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.470470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.470811 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.471670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.471988 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.472329 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.472738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.473018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.473311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.473647 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.473970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.474305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.474639 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.474992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.475316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.475660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.475983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.476320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.476618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.476941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.477270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.477689 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.477917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.478256 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.478575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.478939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.479269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.479601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.479926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.480248 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.480590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.480915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.481243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.481566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.482104 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.482588 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.482955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.483366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.483625 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.484788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.485312 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.492979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.492979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.492979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.492979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 07:47:11.492979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=97389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 13 07:47:11.500708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_db.sqlalchemy.engines [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.526176 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_db.sqlalchemy.engines [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.754012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.context [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b8a17e1-4a8c-41e8-b833-be40a715238f(cell1) {{(pid=97388) load_cells /opt/stack/nova/nova/context.py:465}} Nov 13 07:47:11.758194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:47:11.759885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:47:11.760727 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:47:11.762719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:47:11.780535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.context [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b8a17e1-4a8c-41e8-b833-be40a715238f(cell1) {{(pid=97389) load_cells /opt/stack/nova/nova/context.py:465}} Nov 13 07:47:11.785438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:47:11.787187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:47:11.790892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_db.sqlalchemy.engines [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.791010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:47:11.791135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_db.sqlalchemy.engines [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.791230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:47:11.815105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_db.sqlalchemy.engines [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.815941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_db.sqlalchemy.engines [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.818920 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_db.sqlalchemy.engines [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:11.845266 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_db.sqlalchemy.engines [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 13 07:47:12.072974 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO keyring.backend [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Loading KWallet Nov 13 07:47:12.083197 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO keyring.backend [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Loading SecretService Nov 13 07:47:12.087243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO keyring.backend [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Loading Windows Nov 13 07:47:12.089044 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO keyring.backend [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Loading KWallet Nov 13 07:47:12.089270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO keyring.backend [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Loading chainer Nov 13 07:47:12.090069 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO keyring.backend [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Loading macOS Nov 13 07:47:12.098509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO keyring.backend [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Loading SecretService Nov 13 07:47:12.102425 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO keyring.backend [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Loading Windows Nov 13 07:47:12.104316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO keyring.backend [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Loading chainer Nov 13 07:47:12.105100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO keyring.backend [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Loading macOS Nov 13 07:47:12.344186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: WARNING keystonemiddleware.auth_token [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:47:12.350846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: WARNING keystonemiddleware.auth_token [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:47:12.361508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: WARNING keystonemiddleware.auth_token [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:47:12.368683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: WARNING keystonemiddleware.auth_token [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:47:12.566557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: WARNING keystonemiddleware.auth_token [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:47:12.571765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: WARNING keystonemiddleware.auth_token [None req-e6afbfcb-6cbe-4f99-abc9-07786ca29200 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:47:12.577167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628efa349c0 pid: 97388 (default app) Nov 13 07:47:12.585924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: WARNING keystonemiddleware.auth_token [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 13 07:47:12.591354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: WARNING keystonemiddleware.auth_token [None req-683a2150-810a-487e-877c-c5539fc4bcca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 13 07:47:12.596778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628efa349c0 pid: 97389 (default app) Nov 13 07:47:59.351230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b55c1e95-32ba-4c74-8777-b2b8f0b01304 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Action: 'create', calling method: .version_select at 0x7f54f014d0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1561754150", "metadata": {"Type": "work"}}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:01.538456 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b55c1e95-32ba-4c74-8777-b2b8f0b01304 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.960715 Nov 13 07:48:01.539130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Nov 13 07:47:57 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3963 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 13 07:48:01.561262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-13175fd8-cddb-46d7-a97d-d31a7221669f tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54effb4820>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:01.873694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-13175fd8-cddb-46d7-a97d-d31a7221669f tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 200 len: 353 microversion: 2.1 time: 0.326415 Nov 13 07:48:01.874459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 2/2] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:01 2021] GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 353 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:02.189843 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1877267271", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "94faff74-ffc4-411d-904f-8eb81943caca"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:02.494511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] validate_networks() for [('94faff74-ffc4-411d-904f-8eb81943caca', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:48:02.894035 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7c155ba8-6f5b-419e-864b-c6bdbee6f3d8 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54effb4ee0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:03.027127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7c155ba8-6f5b-419e-864b-c6bdbee6f3d8 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 200 len: 354 microversion: 2.1 time: 0.144702 Nov 13 07:48:03.027884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 3/3] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:02 2021] GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:03.044793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-de11a5ff-e1af-405a-944a-3e872dd031d2 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54eff465e0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:03.186533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-de11a5ff-e1af-405a-944a-3e872dd031d2 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 200 len: 354 microversion: 2.1 time: 0.150553 Nov 13 07:48:03.194080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 4/4] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:03 2021] GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:03.207417 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-09fe79e5-1d83-4191-add5-499611dc6c7b tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54effb4ee0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:03.349642 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:48:03.350273 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:48:03.350568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:48:03.351204 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:48:03.351778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:48:03.364831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:03.365714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:03.366798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:03.367494 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:03.404732 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Getting quotas for project fbf600fbe0b84ca6996e89d94be9615e. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:03.413371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Getting quotas for user 76daecd347b04e10b85b4208f9061efb and project fbf600fbe0b84ca6996e89d94be9615e. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:03.432443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:48:03.436383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:48:03.667627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-09fe79e5-1d83-4191-add5-499611dc6c7b tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 202 len: 0 microversion: 2.1 time: 0.472233 Nov 13 07:48:03.668732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 5/5] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:48:03 2021] DELETE /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:48:03.688385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cd1cef75-4db4-43f1-b713-b5a73c597f08 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54effb4940>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:03.703958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c7cc7d04-8ede-43a4-92fb-c5e0172d55f2 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.850184 Nov 13 07:48:03.704728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 1/6] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:48:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 13 07:48:03.767804 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-70b2faf0-425f-4f80-8229-cbc18a49b420 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:03.768987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-70b2faf0-425f-4f80-8229-cbc18a49b420 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:03.922797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cd1cef75-4db4-43f1-b713-b5a73c597f08 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 200 len: 353 microversion: 2.1 time: 0.249160 Nov 13 07:48:03.923726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 6/7] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:03 2021] GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:03.964830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-70b2faf0-425f-4f80-8229-cbc18a49b420 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:03.999121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-70b2faf0-425f-4f80-8229-cbc18a49b420 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1215 microversion: 2.1 time: 0.274603 Nov 13 07:48:04.008797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 2/8] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:03 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:04.941813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bbc0c510-85a9-4130-a0e4-e80fd4469534 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Calling method '.version_select at 0x7f54eff46820>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:05.025618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cfe9e5d4-14c9-404f-98b8-98a581a831f7 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:05.027335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cfe9e5d4-14c9-404f-98b8-98a581a831f7 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:05.078564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-bbc0c510-85a9-4130-a0e4-e80fd4469534 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] HTTP exception thrown: Volume c2983862-b47c-49ad-9515-1638f2fe07e2 could not be found. Nov 13 07:48:05.079397 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bbc0c510-85a9-4130-a0e4-e80fd4469534 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] Returning 404 to user: Volume c2983862-b47c-49ad-9515-1638f2fe07e2 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:48:05.080606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bbc0c510-85a9-4130-a0e4-e80fd4469534 tempest-VolumesGetTestJSON-921204464 tempest-VolumesGetTestJSON-921204464-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2" status: 404 len: 109 microversion: 2.1 time: 0.148685 Nov 13 07:48:05.081309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 7/9] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:04 2021] GET /compute/v2.1/os-volumes/c2983862-b47c-49ad-9515-1638f2fe07e2 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:48:05.232598 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cfe9e5d4-14c9-404f-98b8-98a581a831f7 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:05.255260 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cfe9e5d4-14c9-404f-98b8-98a581a831f7 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1215 microversion: 2.1 time: 0.243076 Nov 13 07:48:05.268822 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 3/10] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:05 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:06.284660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-09c63e49-e199-41f3-a315-5f6afce4fa08 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:06.286010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-09c63e49-e199-41f3-a315-5f6afce4fa08 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:06.456165 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09c63e49-e199-41f3-a315-5f6afce4fa08 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:06.495644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-09c63e49-e199-41f3-a315-5f6afce4fa08 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1215 microversion: 2.1 time: 0.226045 Nov 13 07:48:06.496648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 8/11] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:06 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:07.569485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:07.570464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:07.601929 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:07.602820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:07.603877 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:07.604973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:08.020597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:08.038083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-32633c4b-113e-49e9-b929-bc08cd540db8 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1211 microversion: 2.1 time: 0.527452 Nov 13 07:48:08.042845 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 4/12] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:07 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1211 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:09.064276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:09.068809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:09.091964 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:09.092661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:09.094336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:09.096370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:09.538143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:09.585831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c292b435-d75a-4e4b-a207-a5537e922c9e tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1267 microversion: 2.1 time: 0.530734 Nov 13 07:48:09.604050 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 9/13] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:09 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1267 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:10.618129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:10.619444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:10.631602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:10.632358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:10.633411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:10.634011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:10.983129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:11.007400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0397b511-b537-4a96-bbdd-03301a505d8d tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1275 microversion: 2.1 time: 0.398376 Nov 13 07:48:11.008714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 5/14] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:10 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1275 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:12.049295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:12.055104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:12.091848 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:12.101711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:12.109086 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:12.114959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:12.944338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:12.944338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-12f628ba-cf79-4da6-a8f3-f26f6708d04a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1273 microversion: 2.1 time: 0.777372 Nov 13 07:48:12.944338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 10/15] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:12 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1273 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:13.271677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0ed2c563-5e16-470a-a638-1377e48c1239 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efe4e9d0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:13.810814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0ed2c563-5e16-470a-a638-1377e48c1239 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/473b4735-d591-410d-9125-86e3d9de9b02" status: 200 len: 350 microversion: 2.1 time: 0.553472 Nov 13 07:48:13.817482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 6/16] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:13 2021] GET /compute/v2.1/os-volumes/473b4735-d591-410d-9125-86e3d9de9b02 => generated 350 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:13.844033 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:13.847060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:13.866357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:13.867646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:13.872434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:13.873166 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:14.251835 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:14.284506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a510ef8e-260a-4869-b877-ff530ce35a57 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1273 microversion: 2.1 time: 0.465975 Nov 13 07:48:14.288788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 11/17] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:13 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1273 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:15.312807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:15.317172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:15.333906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:15.336266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:15.337472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:15.339057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:15.732194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-300019530", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77b75486-1f76-4ec9-bd2f-6841ef30c66e"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:17.149119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:17.209831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-aa452a66-8b65-4f3e-96be-b29fa1ba2d58 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 1.909611 Nov 13 07:48:17.214219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 12/18] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:15 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:17.426873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4be73e9d-4ebf-4a4d-8204-4ab87dc17595 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efe97430>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:17.620318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4be73e9d-4ebf-4a4d-8204-4ab87dc17595 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ee2b93ca-869d-414a-b138-563655490953" status: 200 len: 351 microversion: 2.1 time: 0.202655 Nov 13 07:48:17.620318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 13/19] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:17 2021] GET /compute/v2.1/os-volumes/ee2b93ca-869d-414a-b138-563655490953 => generated 351 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:17.948609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-e62c294f-279a-477f-ba39-67e7b44681ef req-4f5dfee7-7549-448e-aabe-5bbda156782e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a67252-1b36-4f09-9fe7-3f9654ffd111", "tag": "c6e7d913-6aac-4023-b11a-4eca695353a1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:17.962471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:17.962471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:48:17.989177 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e62c294f-279a-477f-ba39-67e7b44681ef req-4f5dfee7-7549-448e-aabe-5bbda156782e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:17.989721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e62c294f-279a-477f-ba39-67e7b44681ef req-4f5dfee7-7549-448e-aabe-5bbda156782e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:18.016763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-e62c294f-279a-477f-ba39-67e7b44681ef req-4f5dfee7-7549-448e-aabe-5bbda156782e service nova] Creating event network-changed:c6e7d913-6aac-4023-b11a-4eca695353a1 for instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 on hv-cinder-81783 Nov 13 07:48:18.024713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e62c294f-279a-477f-ba39-67e7b44681ef req-4f5dfee7-7549-448e-aabe-5bbda156782e service nova] Acquired lock "compute-rpcapi-router" {{(pid=97388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 13 07:48:18.026080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:18.026869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:18.028175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:18.028902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:18.049437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.compute.rpcapi [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Nov 13 07:48:18.054200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] Releasing lock "compute-rpcapi-router" {{(pid=97388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 13 07:48:18.123448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6cd7ae8f-47c6-4e18-85fb-7b5ca2017c3c None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325464 Nov 13 07:48:18.124448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 14/20] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:18.288685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: .version_select at 0x7f54effb4f70>, body: {"keypair": {"name": "tempest-keypair-1064463901"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:18.375957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:18.402059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:19.061357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:19.066471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:19.104369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-32d98a00-270f-47f0-b551-eaa2bd046561 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.978200 Nov 13 07:48:19.105277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 15/21] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Nov 13 07:48:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 980 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 13 07:48:19.130266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:19.131255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:19.161772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:19.164187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:19.166413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:19.167199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:19.624497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:19.658627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-22113ed0-1e9b-4508-93d8-f674518875c1 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.547994 Nov 13 07:48:19.659838 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 16/22] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:19 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:20.291129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: .version_select at 0x7f54efd99040>, body: {"keypair": {"name": "tempest-keypair-279721466"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:20.379742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:20.389263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:20.853816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:20.864885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:20.901985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a7ccdb1-b399-4a80-86b6-556f936eb942 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.240656 Nov 13 07:48:20.903346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 17/23] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Nov 13 07:48:19 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:20.917271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fa66e038-9553-4751-aae7-517cd5a5a028 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efe0aee0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:21.176359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fa66e038-9553-4751-aae7-517cd5a5a028 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/510608d4-862c-4901-ac45-33b94d64b8e8" status: 200 len: 350 microversion: 2.1 time: 0.271787 Nov 13 07:48:21.177359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 18/24] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:48:20 2021] GET /compute/v2.1/os-volumes/510608d4-862c-4901-ac45-33b94d64b8e8 => generated 350 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:21.196540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:21.204117 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:21.221333 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:21.221731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:21.222557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:21.224197 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:21.591181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:21.608192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d46c31c2-857d-482c-8167-45922bf15550 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.429449 Nov 13 07:48:21.609866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 19/25] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:21 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:21.627429 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6264d1e1-3661-48f5-8511-93c1937ba1df tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efe0a1f0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:21.875664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6264d1e1-3661-48f5-8511-93c1937ba1df tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.264115 Nov 13 07:48:21.876320 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 20/26] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Nov 13 07:48:21 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:21.914728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-938e082a-bfc0-48e6-8c02-64403dc358bc tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efd995e0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:22.075908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-938e082a-bfc0-48e6-8c02-64403dc358bc tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.181944 Nov 13 07:48:22.090173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 21/27] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Nov 13 07:48:21 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:22.117554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d3500772-4a8c-4fff-a307-7e88f6556d1e tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efd99820>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:22.276612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d3500772-4a8c-4fff-a307-7e88f6556d1e tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184742 Nov 13 07:48:22.277537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 22/28] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Nov 13 07:48:22 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:22.300356 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-93dcb46f-aa4e-45d8-9f00-0cc855ee77f4 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efd99a60>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:22.484819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-93dcb46f-aa4e-45d8-9f00-0cc855ee77f4 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199302 Nov 13 07:48:22.485539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 23/29] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Nov 13 07:48:22 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:22.519721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0dada4ad-519f-43e4-9fbc-21907439e48b tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efe0adc0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:22.887023 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0dada4ad-519f-43e4-9fbc-21907439e48b tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.391822 Nov 13 07:48:22.888853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 24/30] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Nov 13 07:48:22 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:22.905685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:22.926833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:22.960304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:22.964437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:22.968870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:22.969520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:23.767657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:23.789430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-892ed848-f405-4337-93c4-89d755d9fad5 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.899737 Nov 13 07:48:23.813706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 25/31] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:22 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:23.830968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-26a34842-f3de-4a41-9fac-2b4533b61e11 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efedbe50>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:23.999096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-26a34842-f3de-4a41-9fac-2b4533b61e11 tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.183043 Nov 13 07:48:24.000543 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 26/32] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Nov 13 07:48:23 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:24.021644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-670f7dc6-767e-42ad-952e-c843e3b79cee tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efd99ca0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:24.197495 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-670f7dc6-767e-42ad-952e-c843e3b79cee tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.189942 Nov 13 07:48:24.199312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 27/33] 10.222.0.32 () {58 vars in 1187 bytes} [Sat Nov 13 07:48:24 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:24.222765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bd662340-9bfd-46d3-9ce9-7f591967791e tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] Calling method '.version_select at 0x7f54efd99160>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:24.368133 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bd662340-9bfd-46d3-9ce9-7f591967791e tempest-VolumesTestJSON-1826888046 tempest-VolumesTestJSON-1826888046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.160284 Nov 13 07:48:24.369788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 28/34] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Nov 13 07:48:24 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:24.549771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1243718663", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68227660-1969-4380-bdbb-e55ad209027e"}], "security_groups": [{"name": "tempest-securitygroup--1810951548"}], "key_name": "tempest-keypair-1064463901", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:25.208473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] validate_networks() for [('68227660-1969-4380-bdbb-e55ad209027e', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:48:26.678926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:48:26.680153 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:48:26.680704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:48:26.681332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:48:26.681925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:48:26.694631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:26.694631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:26.694631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:26.694631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:26.713266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:26.718969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:26.732384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:48:26.737156 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:48:26.948620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8a14b9d0-efe6-4885-ba34-efa8f99b8937 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.416486 Nov 13 07:48:26.950070 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 29/35] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Nov 13 07:48:24 2021] POST /compute/v2.1/servers => generated 402 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 13 07:48:26.964268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:26.965250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:26.976604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:26.977352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:26.979167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:26.979837 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:27.053346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] validate_networks() for [('77b75486-1f76-4ec9-bd2f-6841ef30c66e', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:48:27.278169 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:27.287731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7d74d65d-b4d7-4773-bf44-4e935ef8f588 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.336151 Nov 13 07:48:27.288474 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 30/36] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:26 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:27.298598 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1745201819", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4da95-76b6-4434-b98c-5899f375e796"}], "security_groups": [{"name": "tempest-securitygroup--1915630714"}], "key_name": "tempest-keypair-279721466", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:27.435976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] validate_networks() for [('5ce4da95-76b6-4434-b98c-5899f375e796', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:48:28.138788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:48:28.139862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:48:28.140560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:48:28.140985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:48:28.141397 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:48:28.150114 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.150839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.151790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.152376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.170532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Getting quotas for project fb1f9a1ba6464c57932a7fbff537dd1f. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:28.175709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Getting quotas for user 995ddf27861448bc9b5188538792df77 and project fb1f9a1ba6464c57932a7fbff537dd1f. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:28.194195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:48:28.196503 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:48:28.347893 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1ed2e271-67d2-4fa6-92c6-e359c76c9f79 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 13.071606 Nov 13 07:48:28.354736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 7/37] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:48:15 2021] POST /compute/v2.1/servers => generated 383 bytes in 13083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:48:28.401104 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:28.416400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:28.541530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:28.544372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:48:28.544876 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:48:28.545269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:48:28.546299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:48:28.547547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:48:28.562035 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.562541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.563379 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.563815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.586120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:28.599485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:28.599485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d20dd9d2-3950-4e0f-a1b6-b989b6828996 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1282 microversion: 2.20 time: 0.241015 Nov 13 07:48:28.609193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 8/38] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:28 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:28.620097 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:28.620728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:28.625350 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:28.628670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.629322 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.630431 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:28.631108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:28.643730 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:28.681146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:48:28.683401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:48:28.924392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1f42a8b5-d7de-46f2-ae30-9fa629d9db2e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.635067 Nov 13 07:48:28.925614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 31/39] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:48:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:48:28.937055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-25c2da87-fc23-4bb6-8fab-a05f88e16593 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:28.937965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-25c2da87-fc23-4bb6-8fab-a05f88e16593 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:29.042774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.056568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-14e4dd33-58c1-44ba-9d8a-cc0bb4bb3dea tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.445670 Nov 13 07:48:29.058156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 9/40] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:28 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:29.071089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-25c2da87-fc23-4bb6-8fab-a05f88e16593 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.076803 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f5c02347-6db3-4745-81e3-52f7e953d68f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:29.077947 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f5c02347-6db3-4745-81e3-52f7e953d68f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:29.082006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-25c2da87-fc23-4bb6-8fab-a05f88e16593 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1221 microversion: 2.1 time: 0.155116 Nov 13 07:48:29.083196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 32/41] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:28 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:29.197071 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f5c02347-6db3-4745-81e3-52f7e953d68f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.217241 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f5c02347-6db3-4745-81e3-52f7e953d68f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1237 microversion: 2.1 time: 0.156518 Nov 13 07:48:29.219545 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 10/42] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:29 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1237 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:29.253748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-759194457", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77b75486-1f76-4ec9-bd2f-6841ef30c66e"}]}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:29.425593 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] validate_networks() for [('77b75486-1f76-4ec9-bd2f-6841ef30c66e', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:48:29.624865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:29.625522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:29.647382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:29.647846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:29.655871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:29.656277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:29.921973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.963345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.978343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:29.984818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-517ddbdf-0500-4bc8-bff8-0e860075592e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1286 microversion: 2.20 time: 0.372029 Nov 13 07:48:29.985391 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 11/43] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:29 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1286 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:30.081940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:30.082576 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:30.092811 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:30.107489 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:30.110565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:30.115049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:30.631334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:48:30.632380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:48:30.633026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:48:30.633581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:48:30.634140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:48:30.644335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:30.646458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:30.647099 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:30.648881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:30.649791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:30.661718 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b74c6773-64d1-4c11-ac7d-fa2c4bdfedbf tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.591612 Nov 13 07:48:30.664062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 12/44] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:30 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:30.693890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2feaf5dd-caba-4196-9cd9-fe8d663ba6d1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:30.694542 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2feaf5dd-caba-4196-9cd9-fe8d663ba6d1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:30.702652 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Getting quotas for project fb1f9a1ba6464c57932a7fbff537dd1f. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:48:30.709102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Getting quotas for user 995ddf27861448bc9b5188538792df77 and project fb1f9a1ba6464c57932a7fbff537dd1f. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:48:30.727624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:48:30.730482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:48:30.858998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2feaf5dd-caba-4196-9cd9-fe8d663ba6d1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:30.875777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2feaf5dd-caba-4196-9cd9-fe8d663ba6d1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1237 microversion: 2.1 time: 0.210708 Nov 13 07:48:30.879309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 13/45] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:30 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1237 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:31.002402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ee6d439b-e13a-44c7-be4b-2c89c9528cab tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.757076 Nov 13 07:48:31.007839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 33/46] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:48:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:48:31.016029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:31.023533 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:31.043588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-78d78744-ea4d-417a-8a94-1171173ec003 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:31.046399 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-78d78744-ea4d-417a-8a94-1171173ec003 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:31.046509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.046509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:31.046509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.053930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:31.299322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-78d78744-ea4d-417a-8a94-1171173ec003 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:31.327962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:31.341482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-78d78744-ea4d-417a-8a94-1171173ec003 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1221 microversion: 2.1 time: 0.328934 Nov 13 07:48:31.341482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 34/47] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:31 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1221 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:31.399537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:31.453745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:31.456801 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-db8f57e1-6d7c-49ea-8a26-5979569e3a53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1334 microversion: 2.20 time: 0.455819 Nov 13 07:48:31.460161 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 14/48] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:30 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1334 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:31.692995 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:31.694084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:31.761713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.764520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:31.765378 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.769748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:31.902372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:31.903768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:31.911156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.911603 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:31.912540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:31.912979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:32.060615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.079131 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fbec5f66-6133-4202-a883-9102d3aa8856 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.404533 Nov 13 07:48:32.080649 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 35/49] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:31 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:32.231358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.258182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1d9ca735-7663-4a53-8972-c058c24fa32a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1233 microversion: 2.1 time: 0.366110 Nov 13 07:48:32.270390 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 15/50] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:31 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1233 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:32.365946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3008aca1-c112-4090-a261-f8e735ab2a04 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:32.366618 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3008aca1-c112-4090-a261-f8e735ab2a04 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:32.479984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3008aca1-c112-4090-a261-f8e735ab2a04 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.482168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:32.482813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:32.496592 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:32.498533 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:32.501327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:32.501327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:32.558604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3008aca1-c112-4090-a261-f8e735ab2a04 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1221 microversion: 2.1 time: 0.204174 Nov 13 07:48:32.566695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 36/51] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:32 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1221 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:32.844356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.880756 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.895680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:32.897180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-aa78420b-5026-4050-8c22-bb65b6a34874 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1340 microversion: 2.20 time: 0.424758 Nov 13 07:48:32.897910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 16/52] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:32 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1340 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:33.111149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:33.111744 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:33.150362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.151210 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:33.154754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.155625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:33.292953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:33.296906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:33.328557 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.328995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:33.356690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.357395 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:33.777183 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:33.793142 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-788f271b-dc83-48c4-9070-fb65c2b79d2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1289 microversion: 2.1 time: 0.521309 Nov 13 07:48:33.793703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 17/53] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:33 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1289 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:33.819255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:33.820005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:33.829386 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.830082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:33.830964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:33.831407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:34.272378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:34.347429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9f74c519-ebf9-4553-afb3-1b2557d8d20d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1217 microversion: 2.1 time: 0.550230 Nov 13 07:48:34.348747 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 18/54] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:33 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1217 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:34.400150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:34.401094 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:34.436302 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:34.439040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:34.440967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:34.444899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:35.035523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:35.052045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-51ce37e4-d0f3-4e6c-8849-426b210909af tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 1.953188 Nov 13 07:48:35.053051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 37/55] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:33 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:35.077606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:35.080046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:35.099505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:35.101100 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:35.104095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:35.104982 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:35.365456 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:35.397083 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f707ac50-c1b8-4f2d-8b63-f49296b3a0ed tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1295 microversion: 2.1 time: 0.337208 Nov 13 07:48:35.397715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 38/56] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:35 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1295 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:35.417781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:35.437263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:35.466377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:35.467203 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:35.473375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:35.474184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:35.973381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:35.990063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-20a59fbe-c185-47e2-8508-cdcb2d9e390e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1291 microversion: 2.1 time: 0.591257 Nov 13 07:48:35.991609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 39/57] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:35 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1291 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:36.197453 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-84da850b-b900-4c4e-a4a4-357d73dd99ed req-fa9669ba-69d9-4d82-8465-ae7e1402ea2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a67252-1b36-4f09-9fe7-3f9654ffd111", "name": "network-vif-plugged", "status": "completed", "tag": "c6e7d913-6aac-4023-b11a-4eca695353a1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:36.203393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:36.203393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:48:36.213529 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-84da850b-b900-4c4e-a4a4-357d73dd99ed req-fa9669ba-69d9-4d82-8465-ae7e1402ea2f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:36.214388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-84da850b-b900-4c4e-a4a4-357d73dd99ed req-fa9669ba-69d9-4d82-8465-ae7e1402ea2f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:36.241103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-84da850b-b900-4c4e-a4a4-357d73dd99ed req-fa9669ba-69d9-4d82-8465-ae7e1402ea2f service nova] Creating event network-vif-plugged:c6e7d913-6aac-4023-b11a-4eca695353a1 for instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 on hv-cinder-81783 Nov 13 07:48:36.247657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-84da850b-b900-4c4e-a4a4-357d73dd99ed req-fa9669ba-69d9-4d82-8465-ae7e1402ea2f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254572 Nov 13 07:48:36.248826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 40/58] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:36.261665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:36.262711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:36.272704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:36.273478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:36.284105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:36.287746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:36.623758 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:36.661406 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:36.669779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:36.671126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f0c9100d-bb6d-4907-bd24-a7a58d5bc5ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 2.319746 Nov 13 07:48:36.671894 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 19/59] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:34 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:36.699079 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:36.699914 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:36.712807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:36.713272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:36.714069 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:36.714513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:36.950506 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:36.964873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7786c525-b7b7-4faf-8988-2de43ed103da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1295 microversion: 2.1 time: 0.291675 Nov 13 07:48:36.969229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 20/60] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:36 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1295 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:37.016033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:37.019232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:37.040837 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.041303 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.042102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.042541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.270583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:37.280982 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3e7bf09a-9b4d-44e9-b167-e47a782be806 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 1.030783 Nov 13 07:48:37.282493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 41/61] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:36 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:37.559744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:37.574870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7ab63ee7-43b6-4cb9-8f19-a1ec1230da9e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1279 microversion: 2.1 time: 0.570375 Nov 13 07:48:37.576422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 21/62] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:37 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1279 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:37.706043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:37.710427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:37.714094 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-22d3f72b-93cd-405e-87cb-c53716ba011d req-1da13802-e58e-4e7e-8fe0-816d024775be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:37.722257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.722257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.722555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:37.722555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:48:37.726114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.726573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.732569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-22d3f72b-93cd-405e-87cb-c53716ba011d req-1da13802-e58e-4e7e-8fe0-816d024775be service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.733596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-22d3f72b-93cd-405e-87cb-c53716ba011d req-1da13802-e58e-4e7e-8fe0-816d024775be service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.756130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-22d3f72b-93cd-405e-87cb-c53716ba011d req-1da13802-e58e-4e7e-8fe0-816d024775be service nova] Creating event network-changed:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:48:37.757068 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-22d3f72b-93cd-405e-87cb-c53716ba011d req-1da13802-e58e-4e7e-8fe0-816d024775be service nova] Acquired lock "compute-rpcapi-router" {{(pid=97389) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 13 07:48:37.758394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.759043 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.760123 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:37.760874 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:37.774173 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.compute.rpcapi [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Nov 13 07:48:37.775589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] Releasing lock "compute-rpcapi-router" {{(pid=97389) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 13 07:48:37.828686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4ef4cbed-4032-4614-9fac-6dcf609abc36 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133000 Nov 13 07:48:37.829305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 22/63] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:37.992523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:37.993149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:38.003700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:38.004434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:38.005567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:38.006812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:38.491826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:38.509069 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:38.517110 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:38.520691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e9760a3b-8045-43e7-b815-75c5615bfd73 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.835099 Nov 13 07:48:38.521791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 42/64] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:37 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:38.544884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:38.545605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:38.554608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:38.555134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:38.556035 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:38.556634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:39.291471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:39.305171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:39.341945 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6287c15d-1158-47f2-9e78-4ff7d3ccfe7d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 1.360173 Nov 13 07:48:39.410805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 23/65] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:37 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:39.410805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:39.410805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:39.411554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9df5b5f1-8f45-4915-b1f6-b562151c48d3 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.839400 Nov 13 07:48:39.411554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 43/66] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:38 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:39.411688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:39.411688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:39.411688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:39.411688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:39.704045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:39.704045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:39.704045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:39.704045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:39.705692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:39.705692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:39.868726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:39.883780 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:39.890306 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:39.891687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-35c4a86f-9a02-4ddd-8d91-47c92aecaeeb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.353902 Nov 13 07:48:39.892291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 44/67] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:39 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:40.441127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:40.441897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:40.449581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:40.450157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:40.451085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:40.451627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.041627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.049969 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-652a901c-27e1-4346-832c-e4fdff899126 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 1.705430 Nov 13 07:48:41.050905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 24/68] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:39 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:41.061942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:41.064009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:41.070785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.071447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.072392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.072840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.329341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.346568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ebab1f6b-1583-40fa-94c6-42995e29138c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.927521 Nov 13 07:48:41.356661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 45/69] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:40 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:41.381110 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:41.382067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:41.399491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.401619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.403460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.404955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.691657 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.702038 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2045722e-d54e-47ba-9092-0004d583a149 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.648969 Nov 13 07:48:41.703132 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 25/70] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:41 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:41.803149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.817278 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.823809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:41.824910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-70ab4cac-443e-400e-a3f1-efa3f555284f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.467200 Nov 13 07:48:41.825596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 46/71] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:41 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:41.837754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-8becfdc5-92d3-46d6-bd2e-1ff5c63b0d20 req-95c8f45b-cfe6-460d-8a46-6bcb4d8ce116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc42cc46-fcd0-4091-89ee-f85d1bea1c09", "tag": "339633cf-7225-4a17-a0e2-d529e386c0dc"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:41.844348 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:41.844348 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:48:41.853164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-8becfdc5-92d3-46d6-bd2e-1ff5c63b0d20 req-95c8f45b-cfe6-460d-8a46-6bcb4d8ce116 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.853600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-8becfdc5-92d3-46d6-bd2e-1ff5c63b0d20 req-95c8f45b-cfe6-460d-8a46-6bcb4d8ce116 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.870062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-8becfdc5-92d3-46d6-bd2e-1ff5c63b0d20 req-95c8f45b-cfe6-460d-8a46-6bcb4d8ce116 service nova] Creating event network-changed:339633cf-7225-4a17-a0e2-d529e386c0dc for instance cc42cc46-fcd0-4091-89ee-f85d1bea1c09 on hv-cinder-81783 Nov 13 07:48:41.874883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-8becfdc5-92d3-46d6-bd2e-1ff5c63b0d20 req-95c8f45b-cfe6-460d-8a46-6bcb4d8ce116 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047996 Nov 13 07:48:41.875667 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 47/72] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:41.947470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-cb73f993-d627-441c-93be-6a08f7e93474 req-7c326573-8edb-43bd-a81b-bef64d95b261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8908876f-0fbb-43e5-861d-16599dc0dbf8", "tag": "c4fea12e-1c32-4d53-af69-c60642a069fd"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:41.954507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:41.954507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:48:41.962574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-cb73f993-d627-441c-93be-6a08f7e93474 req-7c326573-8edb-43bd-a81b-bef64d95b261 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:41.963067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-cb73f993-d627-441c-93be-6a08f7e93474 req-7c326573-8edb-43bd-a81b-bef64d95b261 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:41.978600 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-cb73f993-d627-441c-93be-6a08f7e93474 req-7c326573-8edb-43bd-a81b-bef64d95b261 service nova] Creating event network-changed:c4fea12e-1c32-4d53-af69-c60642a069fd for instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 on hv-cinder-81783 Nov 13 07:48:41.983694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-cb73f993-d627-441c-93be-6a08f7e93474 req-7c326573-8edb-43bd-a81b-bef64d95b261 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279160 Nov 13 07:48:41.984257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 26/73] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:42.071955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:42.072649 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:42.080434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.080892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.081665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.082101 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.375757 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:42.379245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:42.391300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.392643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.394265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.394925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.511969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:42.522866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f0119624-7a62-4709-ad00-c53dbab3c4ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.460319 Nov 13 07:48:42.525042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 48/74] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:42 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:42.674744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:42.683454 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6ad5f55c-348f-455d-b893-fb1ea4483b7c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.321558 Nov 13 07:48:42.684002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 27/75] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:42 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:42.724576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:42.725175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:42.733718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.734488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.735306 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.735732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.852096 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:42.859799 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:42.879112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.879574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.883566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:42.883981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:42.979177 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:43.001603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8a0437fe-e21c-48ee-80f5-aae5c4576b6a tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.287342 Nov 13 07:48:43.002785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 49/76] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:42 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:43.149923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:43.169341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:43.176832 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:43.177605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8b71eaf6-a077-4d1d-a390-670ea396eef6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.337702 Nov 13 07:48:43.189827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 28/77] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:42 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:43.550315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:43.550947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:43.559685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:43.560196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:43.560982 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:43.561474 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:43.707163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:43.707783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:43.721258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:43.722016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:43.727742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:43.727742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.005714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:44.020753 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8a49d6c5-f748-43ba-a285-37d9d278fb50 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.482220 Nov 13 07:48:44.025699 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 50/78] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:43 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:44.038224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:44.038961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:44.046887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:44.047334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.048781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:44.049204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.093034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:44.101685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-195c938b-6a35-46d7-a61f-95de552c4581 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.405373 Nov 13 07:48:44.102232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 29/79] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:43 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:44.121378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-2270311e-2f04-46fc-a4b6-c4f4e0f3e534 req-fa126816-24b6-43e7-974b-a85caae33d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6", "tag": "05dbf5a8-522c-40dd-8370-3137b750dcd6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:44.127889 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:44.127889 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:48:44.136622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-2270311e-2f04-46fc-a4b6-c4f4e0f3e534 req-fa126816-24b6-43e7-974b-a85caae33d3e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:44.145237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-2270311e-2f04-46fc-a4b6-c4f4e0f3e534 req-fa126816-24b6-43e7-974b-a85caae33d3e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.157950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-2270311e-2f04-46fc-a4b6-c4f4e0f3e534 req-fa126816-24b6-43e7-974b-a85caae33d3e service nova] Creating event network-changed:05dbf5a8-522c-40dd-8370-3137b750dcd6 for instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 on hv-cinder-81783 Nov 13 07:48:44.162917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-2270311e-2f04-46fc-a4b6-c4f4e0f3e534 req-fa126816-24b6-43e7-974b-a85caae33d3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059480 Nov 13 07:48:44.163665 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 30/80] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:44.226945 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:44.228932 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:44.250627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:44.252493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.253507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:44.255242 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:44.822853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:44.859517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-061478fe-037e-4c38-b6ae-6fff602c4635 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1315 microversion: 2.1 time: 0.832466 Nov 13 07:48:44.864988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 51/81] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:44 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:45.051749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:45.060897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:45.064850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:45.088081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:45.091584 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.098040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:45.100804 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.101530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:45.122474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:45.130776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-eb51d37c-289a-4b3f-85bf-18ef8d77b49f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.937832 Nov 13 07:48:45.134113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 31/82] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:44 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:45.171293 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:45.172484 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:45.194218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.195102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:45.198600 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.200253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:45.894567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:45.920826 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-862e6f3d-5480-4665-8783-81706de6b130 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.781781 Nov 13 07:48:45.933466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 32/83] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:45 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:45.956568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:45.958593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:45.980435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.982162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:45.989537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:45.990386 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:46.052090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:46.072148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-91d12def-f738-41b8-a776-5264aef95f0f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 1.027301 Nov 13 07:48:46.085322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 52/84] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:45 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:46.157044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:46.162888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:46.186637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:46.187127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:46.187957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:46.193277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:46.903242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:46.925492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:46.929801 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:46.936789 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:46.938090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f09c45f0-01c0-4fed-9dc7-df6597a9d861 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.792101 Nov 13 07:48:46.939610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 53/85] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:46 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:46.948528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-15a51a44-1e10-42a5-9fb7-51d2c32d4817 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1501 microversion: 2.1 time: 1.010818 Nov 13 07:48:46.957748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 33/86] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:45 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1501 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:46.961161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:46.961783 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:46.982363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:46.988478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:46.989341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:46.993771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:47.114249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:47.115007 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:47.124883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:47.126227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:47.129440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:47.129440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:47.495383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:47.504619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-62c34acb-f8f1-4baa-a084-81c48ee53e0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.413015 Nov 13 07:48:47.505983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 34/87] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:47 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:47.808991 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:47.824410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c24c503a-b0f0-4dfc-8651-766dea9ca71e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.879061 Nov 13 07:48:47.824410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 54/88] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:46 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:47.963761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:47.965371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:47.976759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:47.977220 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:47.978042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:47.978539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:48.305464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:48.324020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:48.331838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:48.333112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4fc4b738-1536-4e7c-a8aa-f9a72d251b51 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.380194 Nov 13 07:48:48.334176 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 35/89] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:47 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:48.531363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:48.532568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:48.541688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:48.542140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:48.542950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:48.543514 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:48.845859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:48.870925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:48.893704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:48.896928 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:48.898558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:48.910087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:48.910087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:48.913540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6b6c3487-8fd3-41f2-8526-4345def2d659 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.395829 Nov 13 07:48:48.914771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 55/90] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:48 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:49.238887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:49.247129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3e12989a-00a2-46eb-9fc3-4f8ee5508859 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.412570 Nov 13 07:48:49.247676 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 36/91] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:48 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:49.356987 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:49.357583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:49.365207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.365657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:49.366437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.366898 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:49.593360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b7431c0-6f1e-419c-a948-5e2196eace63"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:49.594796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:49.603106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.607937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:49.607937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.607937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:49.646758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:49.661993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:49.668578 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:49.669787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5c3a31c3-ab70-474b-a5fe-755180db2fdb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.322217 Nov 13 07:48:49.675380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 56/92] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:49 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:49.939221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:49.939221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:49.943063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.943498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:49.944476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:49.944907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:50.160135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:50.168393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-85d0e6ff-c67e-47a7-a4f8-cbb58cfb1af4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.242612 Nov 13 07:48:50.168999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 57/93] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:49 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:50.270513 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:50.271146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:50.278765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:50.280709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:50.280709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:50.280709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:50.483321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:50.491385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-63eecd2e-ea1d-457e-9b99-8e104a2732aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.230650 Nov 13 07:48:50.492123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 58/94] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:50 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:50.694959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:50.695556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:50.702894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:50.703559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:50.705138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:50.705751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:50.975580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:50.989654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:50.996368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:50.997471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-80db2cad-7c5e-4227-9161-f7d5e52557d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.312869 Nov 13 07:48:50.997999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 59/95] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:50 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:48:51.167010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c7afc533-f2dc-4089-b203-717377a6be49 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "POST /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.583414 Nov 13 07:48:51.167660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 37/96] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:48:49 2021] POST /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111/os-volume_attachments => generated 194 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:51.193241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:51.193808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:51.201048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:51.201497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:51.202270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:51.202736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:51.405554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:51.414321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f2b1d223-c3ef-463d-9ae6-85351d177495 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.230385 Nov 13 07:48:51.418570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 60/97] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:51 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:51.514046 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:51.514704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:51.523407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:51.523857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:51.524629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:51.525073 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:51.725341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:51.733591 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28fc4362-b053-4d7c-9e4b-996c5cd3ebd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.228903 Nov 13 07:48:51.734344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 38/98] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:51 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:52.021127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:52.021659 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:52.028814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.029257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.030013 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.030441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.232448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:52.247419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:52.254187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:52.254895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bc44fbda-bcfe-4603-8aa5-285625a9a48d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.243088 Nov 13 07:48:52.255425 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 61/99] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:52 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:52.436897 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:52.437839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:52.445127 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.445579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.446381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.446856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.660608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:52.668888 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0f4edc18-8a44-40d0-8925-66b24fe8be1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.241266 Nov 13 07:48:52.669451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 39/100] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:52 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:52.756192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:52.756791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:52.763891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.764331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.765086 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:52.765512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:52.961441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:52.969992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4118fdbd-ac51-465e-9a43-f7d7f1de2f80 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.222795 Nov 13 07:48:52.970538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 62/101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:52 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:53.278640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:53.279267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:53.286938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:53.287377 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:53.288135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:53.288565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:53.498807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:53.512566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:53.518781 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:53.519816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-861839fd-c4cc-4bb8-9f94-aae4cf83da38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.250692 Nov 13 07:48:53.520342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 40/102] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:53 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:53.690528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:53.691153 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:53.698392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:53.698877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:53.699650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:53.700081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:53.929395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:53.937638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5cf594da-8d00-49e9-8c67-76a36d0c7d25 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.256210 Nov 13 07:48:53.938179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 63/103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:53 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:53.992605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:53.993641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:54.001628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.002079 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:54.002893 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.003326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:54.215122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:54.223948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-92ca91c1-e632-4955-9576-c6cd79e040cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.241187 Nov 13 07:48:54.224482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 41/104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:53 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:54.543347 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:54.544211 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:54.558018 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.558018 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:54.558018 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.558018 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:54.820460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:54.833939 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:54.840527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:54.841584 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d065d3a6-8310-4377-b700-96baf82899a3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.307987 Nov 13 07:48:54.842102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 64/105] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:54 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:54.960270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:54.961399 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:54.968614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.969182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:54.970216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:54.970650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:55.203916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:55.211864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0a1a6030-3b0f-4269-8074-8996173d619f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.261493 Nov 13 07:48:55.212399 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 42/106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:54 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:48:55.247357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:55.248022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:55.256344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:55.256790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:55.257563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:55.257996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:55.693708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:55.703065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-925d797b-5124-4b78-a0c5-ada5540d4ab3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.465053 Nov 13 07:48:55.704766 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 65/107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:55 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:55.868099 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:55.869236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:55.878641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:55.879515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:55.881160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:55.881890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:56.100513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:56.117548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:56.126247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:56.127416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-70c2fda5-5bf9-4198-8498-b50186c925b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.271329 Nov 13 07:48:56.127954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 43/108] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:55 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:56.234161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:56.235497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:56.242793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:56.243255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:56.244046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:56.244484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:56.471807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:56.480240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7abcd8f8-b514-4c39-b781-f8497f0d961e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.255724 Nov 13 07:48:56.481731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 66/109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:56 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:56.589101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-015349e3-6a2f-47d6-93cf-e3ddaa7984da req-3130c0ce-6371-4ce2-b273-b9e30e47d084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc42cc46-fcd0-4091-89ee-f85d1bea1c09", "name": "network-vif-plugged", "status": "completed", "tag": "339633cf-7225-4a17-a0e2-d529e386c0dc"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:56.597820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:56.597820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:48:56.607135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-015349e3-6a2f-47d6-93cf-e3ddaa7984da req-3130c0ce-6371-4ce2-b273-b9e30e47d084 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:56.608372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-015349e3-6a2f-47d6-93cf-e3ddaa7984da req-3130c0ce-6371-4ce2-b273-b9e30e47d084 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:56.632945 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-015349e3-6a2f-47d6-93cf-e3ddaa7984da req-3130c0ce-6371-4ce2-b273-b9e30e47d084 service nova] Creating event network-vif-plugged:339633cf-7225-4a17-a0e2-d529e386c0dc for instance cc42cc46-fcd0-4091-89ee-f85d1bea1c09 on hv-cinder-81783 Nov 13 07:48:56.638020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-015349e3-6a2f-47d6-93cf-e3ddaa7984da req-3130c0ce-6371-4ce2-b273-b9e30e47d084 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061732 Nov 13 07:48:56.639138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 44/110] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:48:56.727307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:56.728238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:56.737057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:56.737740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:56.738882 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:56.739496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:57.051837 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:57.059693 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b036562d-3d69-46bf-92d9-1ab80cd2700a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.342601 Nov 13 07:48:57.060222 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 67/111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:56 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:57.151848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:57.152542 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:57.160882 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:57.161338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:57.162102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:57.162539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:57.372713 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:57.386551 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:57.393614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:57.394767 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-805644c9-62e9-43bc-be18-2b3e995e97ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.252516 Nov 13 07:48:57.395297 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 45/112] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:57 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:57.503614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:57.504326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:57.511457 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:57.511908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:57.512685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:57.513149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:57.728411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:57.740186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3ad4a779-271c-40ab-b361-f70489f8e59f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.246366 Nov 13 07:48:57.751294 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 68/113] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:57 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:58.082605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:58.083258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:58.105808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.106197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.107023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.107460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.327042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:58.332752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1865149f-0c91-4fc8-8c2f-a0783d08a774 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.259671 Nov 13 07:48:58.338742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 46/114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:58 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:58.418657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:58.419294 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:58.426953 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.427412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.428186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.428619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.636548 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:58.651117 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:58.657816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:58.658659 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6", "name": "network-vif-plugged", "status": "completed", "tag": "05dbf5a8-522c-40dd-8370-3137b750dcd6"}, {"server_uuid": "8908876f-0fbb-43e5-861d-16599dc0dbf8", "name": "network-vif-plugged", "status": "completed", "tag": "c4fea12e-1c32-4d53-af69-c60642a069fd"}, {"server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "name": "network-vif-plugged", "status": "completed", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:48:58.666204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-90af6e48-9bbf-4458-af0d-c9b395de2dae tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.249444 Nov 13 07:48:58.666204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 69/115] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:58 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:48:58.666410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:48:58.666410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:48:58.674840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.675291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.694469 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Creating event network-vif-plugged:05dbf5a8-522c-40dd-8370-3137b750dcd6 for instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 on hv-cinder-81783 Nov 13 07:48:58.695015 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Creating event network-vif-plugged:c4fea12e-1c32-4d53-af69-c60642a069fd for instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 on hv-cinder-81783 Nov 13 07:48:58.695528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] Creating event network-vif-plugged:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:48:58.704241 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-89bc50d5-f384-46ff-9a5f-4607448f38a5 req-4c813bfb-f437-4934-93b6-49384dde3ce5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054867 Nov 13 07:48:58.704828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 47/116] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:48:58.762841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:58.763451 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:58.771541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.780695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.780695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:58.780695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:58.975578 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:58.983956 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bc4e6fb6-1370-4735-a428-593e3bc2a263 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.230653 Nov 13 07:48:58.984511 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 70/117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:58 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:59.355960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:59.356664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:59.364963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:59.365419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:59.366200 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:59.366637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:59.572218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:59.580515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f730e334-e445-4bcd-9e48-71dcb683c545 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.234227 Nov 13 07:48:59.581621 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 48/118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:59 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:48:59.695443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:48:59.698277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:48:59.710917 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:59.711366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:59.712142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:48:59.712569 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:48:59.944239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:59.960246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:59.967112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:48:59.968201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-90b45525-9e31-4cbe-8088-b5f432f7d139 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.294863 Nov 13 07:48:59.969018 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 71/119] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:48:59 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:49:00.007966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:00.008589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:00.020164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:00.020616 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:00.024090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:00.024090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:00.252345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:00.294140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bc1a21ec-87b9-41c9-90e6-82496ad00b9d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.295276 Nov 13 07:49:00.297072 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 49/120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:48:59 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:00.603521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:00.609014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:00.626622 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:00.628090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:00.631406 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:00.632540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:00.855607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:00.864567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-445eb3c4-1e5b-468e-b6b2-18eb18947d71 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.271110 Nov 13 07:49:00.865096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 72/121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:00 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:00.999229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:00.999229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:01.010059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.010700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:01.011634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.012206 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:01.256906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:01.271018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:01.277377 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:01.278430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d59f4ef6-f633-4214-8475-89f3fd968c13 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.294047 Nov 13 07:49:01.278990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 50/122] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:49:00 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:49:01.317933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:01.318626 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:01.325735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.326207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:01.326972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.327402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:01.539171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:01.553499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5cc768ab-2550-4a41-b915-623d60463851 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1321 microversion: 2.1 time: 0.245297 Nov 13 07:49:01.557973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 73/123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:01 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:01.886351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:01.886993 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:01.894102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.894544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:01.895363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:01.895788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:02.103619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:02.112734 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-96cacd73-2978-48eb-b5be-08d2e26cbdff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1363 microversion: 2.1 time: 0.235473 Nov 13 07:49:02.113272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 51/124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:01 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:02.302327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:02.303613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:02.310564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:02.311040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:02.312074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:02.312908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:02.549624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:02.580653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:02.583626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:02.586079 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:02.614139 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:02.614727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:02.616602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:02.624766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:02.624766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:02.630931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-80c3d6e9-ff68-48b0-b4fa-e448900207de tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1408 microversion: 2.20 time: 0.332219 Nov 13 07:49:02.631859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 74/125] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:49:02 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1408 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:49:02.953275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:02.968878 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3e96185b-94d4-444a-a58e-50285ce98a71 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1515 microversion: 2.1 time: 0.399275 Nov 13 07:49:02.969427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 52/126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:02 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:02.994255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:02.995367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:03.003291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.003741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.004823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.005493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.100971 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lazy-loading 'flavor' on Instance uuid cc42cc46-fcd0-4091-89ee-f85d1bea1c09 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:49:03.138986 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:03.139609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:03.190415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.190912 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.193774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.195144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.492349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:03.500710 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-024d6ad0-6371-42b3-ac49-5aa24b178918 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1550 microversion: 2.1 time: 0.374639 Nov 13 07:49:03.501259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 53/127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:03 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1550 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:03.515770 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:03.516631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:03.525616 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.526157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.527027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.527534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.598472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:49:03.618609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b2f85605-d4aa-41a7-bdc7-e70fec160fba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09/action" status: 200 len: 32 microversion: 2.1 time: 0.634010 Nov 13 07:49:03.620022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 75/128] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:02 2021] POST /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09/action => generated 32 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:03.634339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:03.635359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:03.644759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.645213 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.646185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.646759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.819401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8955ceb2-0101-4c49-8776-db0e92d5a999 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197601 Nov 13 07:49:03.820071 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 76/129] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Nov 13 07:49:03 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:03.833140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:03.834184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:03.842359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.842973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.843756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:03.844194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:03.991816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2d1930fd-a4c7-4848-96b5-27dda012ec4c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 204 len: 0 microversion: 2.1 time: 0.488248 Nov 13 07:49:03.992403 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 54/130] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:49:03 2021] DELETE /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:49:04.004329 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:04.005030 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:04.012850 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.013298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.014087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.014514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.281061 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:04.319719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-be95ac36-0b20-44fd-9915-b8eb7eb92aff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.498533 Nov 13 07:49:04.320434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 77/131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:03 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:04.340052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:04.340694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:04.349189 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.349619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.350385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.350840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.500781 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:04.560963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:04.575389 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:04.580338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-298b84ae-fa65-463c-abd8-76f65701d2b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1598 microversion: 2.20 time: 0.585904 Nov 13 07:49:04.581673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 55/132] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:49:03 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1598 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:49:04.616220 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:04.623918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:04.624243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:04.633974 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5ad2a649-2faa-4588-a7a5-b879ec61142c tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1553 microversion: 2.1 time: 0.312634 Nov 13 07:49:04.634545 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 78/133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:04 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:04.640015 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.640474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.641188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:04.641784 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:04.953405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5f606fe4-30b8-4e5e-9d09-fcc971098e34 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.356692 Nov 13 07:49:04.954335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 56/134] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Nov 13 07:49:04 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-interface => generated 285 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:05.343139 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:05.348680 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:05.352380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:05.353570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:05.354539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:05.355717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:05.659304 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:05.660059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:05.668235 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:05.672449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:05.672449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:05.672449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:05.867223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:05.886774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0dca3ba1-c652-4468-92ab-f0c2d4e2c233 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.553789 Nov 13 07:49:05.888123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 79/135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:05 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:06.006478 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:06.015125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3daeeb8e-1c8c-485e-92a7-33e3515927fc tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1553 microversion: 2.1 time: 0.365869 Nov 13 07:49:06.015804 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 57/136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:05 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:06.908737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:06.909979 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:06.917581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:06.918242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:06.919274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:06.919856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:06.950546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:06.951721 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:06.960612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:06.961308 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:06.964055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:06.964657 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.097481 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d602d424-e1ad-46ba-95f1-1ef177152eae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.160151 Nov 13 07:49:07.100848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 58/137] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:06 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:49:07.110320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-5d5f6f67-293f-42d1-b142-cf65ff322883 req-480ac0b8-ceeb-4ba8-b940-fca771c5e23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6", "tag": "05dbf5a8-522c-40dd-8370-3137b750dcd6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:07.127956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:07.127956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:49:07.147880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-5d5f6f67-293f-42d1-b142-cf65ff322883 req-480ac0b8-ceeb-4ba8-b940-fca771c5e23c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.154997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-5d5f6f67-293f-42d1-b142-cf65ff322883 req-480ac0b8-ceeb-4ba8-b940-fca771c5e23c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.178352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-5d5f6f67-293f-42d1-b142-cf65ff322883 req-480ac0b8-ceeb-4ba8-b940-fca771c5e23c service nova] Creating event network-changed:05dbf5a8-522c-40dd-8370-3137b750dcd6 for instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 on hv-cinder-81783 Nov 13 07:49:07.188761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-5d5f6f67-293f-42d1-b142-cf65ff322883 req-480ac0b8-ceeb-4ba8-b940-fca771c5e23c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085388 Nov 13 07:49:07.189979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 59/138] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:07.207138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:07.208496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:07.222248 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.223383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.224561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.225206 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.363203 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:07.381148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-278d816d-b4eb-48bb-9b95-8b0ef1398dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.481680 Nov 13 07:49:07.382133 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 80/139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:06 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:07.681885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:07.683062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:07.691631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.692468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.693458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.694059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.739442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:07.754265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c409c0a3-3060-4f51-a502-287919eb1967 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1553 microversion: 2.1 time: 0.562828 Nov 13 07:49:07.773180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 60/140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:07 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1553 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:07.788858 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-f0d52db1-bdfb-4b5c-9e31-bdce3451023a req-5e717f10-6264-4c31-b48c-92523e34d066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:07.807332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:07.807332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:49:07.813326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-f0d52db1-bdfb-4b5c-9e31-bdce3451023a req-5e717f10-6264-4c31-b48c-92523e34d066 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:07.814575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-f0d52db1-bdfb-4b5c-9e31-bdce3451023a req-5e717f10-6264-4c31-b48c-92523e34d066 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:07.854350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-f0d52db1-bdfb-4b5c-9e31-bdce3451023a req-5e717f10-6264-4c31-b48c-92523e34d066 service nova] Creating event network-changed:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:49:07.868286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-f0d52db1-bdfb-4b5c-9e31-bdce3451023a req-5e717f10-6264-4c31-b48c-92523e34d066 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095309 Nov 13 07:49:07.869191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 61/141] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:07.936954 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bf74ffda-3d4f-4563-a3a1-9b467e6bad03 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.264087 Nov 13 07:49:07.942510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 81/142] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:07 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:08.119335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:08.121901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:08.140524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.142852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:08.145193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.149290 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:08.299193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-210c139d-f46a-49ec-88ee-dc65eaa09159 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.193355 Nov 13 07:49:08.299950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 62/143] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:08 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:08.405810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:08.406834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:08.424204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.424901 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:08.425928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.426557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:08.798089 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:08.799407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:08.811553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.814112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:08.815527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:08.818164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:09.193282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:09.207386 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8686ef9f-a7b7-4ca2-874d-97812b8ed917 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1553 microversion: 2.1 time: 0.430702 Nov 13 07:49:09.209412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 63/144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:08 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1553 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:09.219499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:09.221033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:09.228395 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:09.228839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:09.229618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:09.230048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:09.346638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d1526de9-6f89-4a88-a2f8-738e3ec6dd2d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.136827 Nov 13 07:49:09.350583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 64/145] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:09 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:09.365101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:09.366620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:09.377664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:09.378434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:09.379473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:09.380000 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:09.466556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:09.478570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-76f6a2b3-11bd-4f49-a150-2dedc889c42b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 1.083332 Nov 13 07:49:09.480452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 82/146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:08 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:09.503851 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dccf2a60-dc09-4dca-84c8-55fba035b8a3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.151480 Nov 13 07:49:09.507067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 65/147] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:09 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:10.133669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-c73347e4-aa7b-45dc-bc38-1ccf45f68abf req-d8223582-99f8-462a-b876-857a6d417942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a67252-1b36-4f09-9fe7-3f9654ffd111", "name": "network-vif-deleted", "tag": "c6e7d913-6aac-4023-b11a-4eca695353a1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:10.163249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:10.163249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:49:10.182955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c73347e4-aa7b-45dc-bc38-1ccf45f68abf req-d8223582-99f8-462a-b876-857a6d417942 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.189377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c73347e4-aa7b-45dc-bc38-1ccf45f68abf req-d8223582-99f8-462a-b876-857a6d417942 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.214925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-c73347e4-aa7b-45dc-bc38-1ccf45f68abf req-d8223582-99f8-462a-b876-857a6d417942 service nova] Creating event network-vif-deleted:c6e7d913-6aac-4023-b11a-4eca695353a1 for instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 on hv-cinder-81783 Nov 13 07:49:10.229668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-c73347e4-aa7b-45dc-bc38-1ccf45f68abf req-d8223582-99f8-462a-b876-857a6d417942 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095592 Nov 13 07:49:10.236265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 83/148] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:10.238026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:10.256328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:10.268422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.268422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.268422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.268422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.365201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:10.366845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:10.387387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.387387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.387387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.387387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.453905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:10.464977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-eb42220b-034b-483f-b0cf-ceffa163e204 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1511 microversion: 2.1 time: 0.243137 Nov 13 07:49:10.465713 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 66/149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:10 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:10.503221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:10.504174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:10.511853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.512650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.513780 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.514374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.592799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9d289d36-5ba3-42c6-8007-2401c4d2ac07 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.238738 Nov 13 07:49:10.593871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 84/150] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:10 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:10.630527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:10.630527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:10.636011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.636680 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.637696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:10.638173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:10.778429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:10.791166 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-88f26c97-1632-475a-81cb-e00568804cdf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.195732 Nov 13 07:49:10.793231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-20b069bc-ddb7-4509-b3f6-6be4ab574bff tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.299624 Nov 13 07:49:10.795006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 85/151] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:10 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:10.803257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 67/152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:10 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:11.492261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:11.493328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:11.503713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.504766 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.505782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.506383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.619814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:11.622325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:11.632029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.632704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.633684 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.634842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.662113 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.662751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.663074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lazy-loading 'fault' on Instance uuid e9a67252-1b36-4f09-9fe7-3f9654ffd111 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:49:11.810100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bded8358-be94-436a-9de1-572e32057a9f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.209917 Nov 13 07:49:11.811518 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 68/153] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:11 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:11.827978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:11.827978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:11.834327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.835074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.836283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.836872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.890811 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76daecd347b04e10b85b4208f9061efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf600fbe0b84ca6996e89d94be9615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:11.902268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-82e68b55-bafc-4bf4-9143-b119a2bf9b97 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 200 len: 1351 microversion: 2.1 time: 0.423104 Nov 13 07:49:11.912343 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 86/154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:11 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 1351 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:11.922539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:11.923725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:11.932232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.932993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.933939 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:11.934514 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:11.956269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-15fc40da-a23d-4e56-8033-977defc55625 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.142703 Nov 13 07:49:11.957102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 69/155] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:11 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:12.238512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:12.249330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-81cfbcb1-7a66-4514-b936-8faff4638511 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.335869 Nov 13 07:49:12.250408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 87/156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:11 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:12.828540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:12.834080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:12.837813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.838262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.839063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.839497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.932330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:12.932946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:12.941377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.941692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.942465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.942918 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.943425 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f0c9ab15-2e54-4c67-8ad3-ebcd66426361 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.125211 Nov 13 07:49:12.946621 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 70/157] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:12 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:12.973935 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:12.974973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:12.992337 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.992809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.995956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:12.995956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:12.996122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] HTTP exception thrown: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. Nov 13 07:49:12.996122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Returning 404 to user: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:49:12.996310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-21a0247e-fe91-4680-8d24-1aabb71e4a89 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 404 len: 111 microversion: 2.1 time: 0.080271 Nov 13 07:49:12.997297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 88/158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:12 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:49:13.109854 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-736cb50b-cb5c-4a34-804a-b547651d0615 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.146070 Nov 13 07:49:13.110482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 71/159] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:12 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:13.197644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:13.198562 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:13.205865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.206458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:13.207287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.211541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:13.260754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] HTTP exception thrown: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. Nov 13 07:49:13.261360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Returning 404 to user: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:49:13.262389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cf13460f-75c8-4403-8bd5-3312ed5a1f81 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074546 Nov 13 07:49:13.263098 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 89/160] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:49:13 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:49:13.275680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:13.280284 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:13.286189 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.286645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:13.287618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.288059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:13.788520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:13.798293 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e9eba98-a4d8-4cb1-ac20-6d68351a0f1c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.534673 Nov 13 07:49:13.799279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 72/161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:13 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:13.966833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:13.969193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:13.980653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.981128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:13.982043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:13.982886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.110090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c1ad2919-b982-4a7c-9b72-0a2a9b642aa0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.160142 Nov 13 07:49:14.111262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 90/162] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:13 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:14.137546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:14.138702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:14.148123 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.148785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.149710 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.150246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.277363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-26f0f963-4877-4241-85b5-32098c756511 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.155539 Nov 13 07:49:14.277976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 73/163] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:14 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:14.822044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:14.823370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:14.853124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.856500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.859184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.860042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.882513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:14.883150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:14.892399 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.892994 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.893796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:14.894328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:14.977237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] HTTP exception thrown: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. Nov 13 07:49:14.978143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Returning 404 to user: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:49:14.979223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7c54ac0a-d1a0-4c4a-84e7-6fb812dbb848 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 404 len: 111 microversion: 2.1 time: 0.109641 Nov 13 07:49:14.980314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 74/164] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:49:14 2021] DELETE /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:49:14.996087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:15.000732 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] [instance: e9a67252-1b36-4f09-9fe7-3f9654ffd111] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:15.012340 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.012820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.013802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.014379 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.094554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] HTTP exception thrown: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. Nov 13 07:49:15.095759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] Returning 404 to user: Instance e9a67252-1b36-4f09-9fe7-3f9654ffd111 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:49:15.096563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2f3c4f97-710e-464b-af4e-56d166398df9 tempest-DeleteServersTestJSON-1163988515 tempest-DeleteServersTestJSON-1163988515-project] 10.222.0.32 "GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111" status: 404 len: 111 microversion: 2.1 time: 0.111995 Nov 13 07:49:15.106972 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 75/165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:14 2021] GET /compute/v2.1/servers/e9a67252-1b36-4f09-9fe7-3f9654ffd111 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:49:15.132925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:15.132925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:15.145410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.149650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.150848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.151430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.221431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:15.233773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7d3660fa-6e9d-47fb-81e1-968608a71ec8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.421669 Nov 13 07:49:15.234314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 91/166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:14 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:15.264140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4849d44f-1b66-40e6-b500-ab4c2fe9178a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.146339 Nov 13 07:49:15.265197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 76/167] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:15 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:15.294388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:15.295563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:15.312398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.312398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.312398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:15.312398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:15.406911 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-629f5a34-313d-4fa8-8b0e-9606acabb1aa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.121455 Nov 13 07:49:15.408244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 92/168] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:15 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:16.256766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:16.257627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:16.266025 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.266849 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.267841 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.268673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.284515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:16.286390 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:16.294307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.295089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.296273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.296864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.422009 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c694899c-647f-4de9-9b8c-de3e4d86feec tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.149289 Nov 13 07:49:16.426167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 93/169] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:16 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:16.437226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:16.438232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:16.445708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.446376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.447307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:16.447738 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:16.604817 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-53f7177c-9702-494f-9a31-7e85b0a8b76a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 14 microversion: 2.1 time: 0.180324 Nov 13 07:49:16.606011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 94/170] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:16 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:16.627635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:16.635836 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bd380aef-dd37-4103-817b-a456a0b73d0a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.388977 Nov 13 07:49:16.636373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 77/171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:16 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:17.439625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:17.440668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:17.448731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.449184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.449956 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.450389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.567236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7f47fd1d-89c5-4ee5-870a-0fdc37a43d97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 14 microversion: 2.20 time: 0.137167 Nov 13 07:49:17.568195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 95/172] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:17 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:17.621560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:17.622469 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:17.633427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.633868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.634701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.635138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.660219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:17.660819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:17.670650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.671135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.675321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:17.675321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:17.769872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-13c6402b-1675-4775-84c7-c03537066d19 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 8153 microversion: 2.1 time: 0.157239 Nov 13 07:49:17.770499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 78/173] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:17 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 8153 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:17.891830 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:17.900736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7695bf53-f2ff-4a15-bcb0-3c42eee11ca7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.251117 Nov 13 07:49:17.902706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 96/174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:17 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:18.593252 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:18.596045 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:18.614469 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.615050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:18.617880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.618486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:18.744745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-807ab0bd-fc98-4b9e-ac5f-b1cf78a076d7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 2671 microversion: 2.20 time: 0.169137 Nov 13 07:49:18.746660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 79/175] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:18 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 2671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:49:18.787551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:18.788481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:18.803408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.803821 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:18.804926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.805502 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:18.925378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:18.926141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:18.944952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6ef235a4-427a-4298-a353-5196e6d0cece tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 15025 microversion: 2.1 time: 0.163790 Nov 13 07:49:18.944952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 97/176] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:18 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 15025 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:18.945116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.946516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:18.947378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:18.947818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:19.172847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:19.181645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d9ab1575-23ed-436f-bda8-9362fc52cea9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.266533 Nov 13 07:49:19.186810 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 80/177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:18 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:19.770881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:19.771902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:19.780770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:19.781241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:19.782004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:19.782464 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:19.914025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6c80259c-e13f-41e1-afa4-938a05270a4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 12093 microversion: 2.20 time: 0.155724 Nov 13 07:49:19.917767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 98/178] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:19 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 12093 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:19.960420 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:19.961348 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:19.968728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:19.970887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:19.970887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:19.970887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:20.095897 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f66057e2-f531-4881-b325-02d396e4f06f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 18109 microversion: 2.1 time: 0.145807 Nov 13 07:49:20.103072 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 81/179] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:19 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 18109 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:20.204522 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:20.205234 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:20.220506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:20.220506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:20.220506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:20.220506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:20.465025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:20.484311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-154cab10-5351-4fc3-926e-f7bee0d36b06 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.289634 Nov 13 07:49:20.487678 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 99/180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:20 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:20.933630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:20.935218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:20.958718 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:20.959172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:20.960014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:20.966966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:21.107057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-694845d9-77f4-4899-bf42-ba994bfab0bb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 17171 microversion: 2.20 time: 0.184846 Nov 13 07:49:21.108421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 82/181] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:20 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 17171 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:21.120475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:21.122062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:21.130412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:21.130980 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:21.131763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:21.132368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:21.270276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d78f8161-83c1-4798-a0da-96dd26c233b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 19342 microversion: 2.1 time: 0.164388 Nov 13 07:49:21.275354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 100/182] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:21 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 19342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:21.507105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:21.507809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:21.515959 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:21.518738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:21.518738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:21.518738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:21.803395 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:21.811429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7f2c38f7-7dc4-4e1c-ad46-467ea03e9c5d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.314054 Nov 13 07:49:21.811960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 83/183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:21 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:22.127091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:22.129107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:22.140380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.144706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:22.144706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.144706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:22.276943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7e82077e-9b01-4e0c-b533-eac0d900f844 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 18305 microversion: 2.20 time: 0.160135 Nov 13 07:49:22.277684 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 101/184] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:22 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 18305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:22.290392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:22.291464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:22.298577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.299056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:22.299865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.300299 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:22.424777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-be67bec9-1153-4c95-99f7-dd1ef028e56a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 22021 microversion: 2.1 time: 0.146342 Nov 13 07:49:22.426006 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 84/185] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:22 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 22021 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:22.835536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:22.836253 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:22.844165 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.844642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:22.845439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:22.845875 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:23.139892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:23.150217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9e9b0724-405c-4b11-82b5-bd61dcb33ed7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.324545 Nov 13 07:49:23.151398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 102/186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:22 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:23.294542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:23.297327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:23.306209 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:23.307089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:23.308060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:23.308639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:23.452193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1659785548", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "13dc6fb3-9bcb-4e4a-8416-084631603788"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:23.466317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f20145c9-16be-4a0a-afa1-c730f35307d8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 20271 microversion: 2.20 time: 0.180682 Nov 13 07:49:23.466986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 103/187] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:23 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 20271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:23.487523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:23.488574 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:23.516462 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:23.522959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:23.523942 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:23.524776 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:23.598835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] validate_networks() for [('13dc6fb3-9bcb-4e4a-8416-084631603788', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:49:23.697404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2a6e8ad4-3e6d-41ac-9c46-5a05a16e6cd4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 23800 microversion: 2.1 time: 0.218948 Nov 13 07:49:23.697404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 104/188] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:23 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 23800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:24.173556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:49:24.173987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:49:24.175053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:49:24.175472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:49:24.175886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:49:24.181822 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:24.187874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:24.192229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.192935 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.194182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.194689 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.202182 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.202639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.203459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.203900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.233835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:49:24.238756 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for user e0728501bcf8493a8704d5ca9f4dadf0 and project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:49:24.250262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:49:24.252729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:49:24.430654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:24.438659 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-95a35eaa-af69-46c5-bcdf-6092ffa6a475 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.275143 Nov 13 07:49:24.439219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 105/189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:24 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:24.472910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-eb92d89d-3dca-4c32-a181-cfa4c811363e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226824 Nov 13 07:49:24.477453 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 85/190] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:49:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:49:24.485388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:24.486538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:24.488789 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bfbd14bf-f4d0-46eb-bd5f-fbb1e6506654 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:24.489610 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bfbd14bf-f4d0-46eb-bd5f-fbb1e6506654 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:24.512369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.513002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.527761 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.528375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.646202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bfbd14bf-f4d0-46eb-bd5f-fbb1e6506654 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:24.656214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bfbd14bf-f4d0-46eb-bd5f-fbb1e6506654 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1218 microversion: 2.1 time: 0.177584 Nov 13 07:49:24.656988 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 86/191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:24 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:24.725965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:24.727569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:24.737852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.739026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.739966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:24.740549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:24.782507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cb559b49-7965-45ed-b50e-5ec91379a18c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 22494 microversion: 2.20 time: 0.307410 Nov 13 07:49:24.786357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 106/192] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:24 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 22494 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:24.873801 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c530d509-4abb-41ed-a537-1097a57e3d82 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 24980 microversion: 2.1 time: 0.175009 Nov 13 07:49:24.875847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 87/193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:24 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 24980 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:25.466161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:25.467540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:25.476773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.477241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.477976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.478404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.684445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-42dc3033-9414-422e-ba90-1f07dfa102df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:25.685278 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-42dc3033-9414-422e-ba90-1f07dfa102df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:25.727263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:25.739444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2f2cdd18-96b3-4ca7-a2c5-1c2d225ec165 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.287073 Nov 13 07:49:25.739995 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 107/194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:25 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:25.773853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-42dc3033-9414-422e-ba90-1f07dfa102df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:25.781823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-42dc3033-9414-422e-ba90-1f07dfa102df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1218 microversion: 2.1 time: 0.108572 Nov 13 07:49:25.782347 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 88/195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:25 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:25.804517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:25.805381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:25.813677 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.814117 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.816278 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.816718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.893549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:25.894522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:25.902865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.903502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.904470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:25.904904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:25.934173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e3c04611-fc5e-4d9d-b8ac-38d7cd572de7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 23803 microversion: 2.20 time: 0.137871 Nov 13 07:49:25.935412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 108/196] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:25 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 23803 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:26.039234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1bf7d68e-5fc1-460d-acbb-1a282984f17f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 26170 microversion: 2.1 time: 0.155173 Nov 13 07:49:26.039950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 89/197] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:25 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 26170 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:26.771205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:26.773250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:26.781392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:26.781840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:26.782614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:26.783075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:26.806928 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:26.808270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:26.817461 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:26.818272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:26.819199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:26.819754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:26.969514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:26.987853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3d473081-04b4-41e6-9e98-0cb96ec6456b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1214 microversion: 2.1 time: 0.185243 Nov 13 07:49:26.987853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 90/198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:26 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:26.994451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:26.995773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:27.003660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:27.004110 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:27.004900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:27.005370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:27.041247 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:27.053937 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4672448d-0aa1-4ced-b3cb-ddf6d4a4aeb3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.301714 Nov 13 07:49:27.054468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 109/199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:26 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:27.076828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:27.078154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:27.086230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:27.086931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:27.088143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:27.088579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:27.134130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-86d27464-2d82-4faf-b0b3-9837b8955d60 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 24948 microversion: 2.20 time: 0.149521 Nov 13 07:49:27.136120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 91/200] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:26 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 24948 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:27.226036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-11a66cbe-d088-48a3-bd01-9f0fe5903f75 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 27075 microversion: 2.1 time: 0.170138 Nov 13 07:49:27.230069 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 110/201] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:27 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 27075 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:28.012811 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:28.013763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:28.024367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.024913 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.025908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.026795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.079953 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:28.081202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:28.088952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.089637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.090591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.091063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.191975 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:28.200594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-91a7435d-ca9b-4acd-8a98-7d9d508e914d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1278 microversion: 2.1 time: 0.203756 Nov 13 07:49:28.201442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 92/202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:27 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:28.212593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:28.213724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:28.222628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.224265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.225693 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.226797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.354521 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-81ebbee2-a7f7-45e9-8cec-f24f9bf36f08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 26126 microversion: 2.20 time: 0.150946 Nov 13 07:49:28.356114 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 93/203] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:28 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 26126 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:28.374144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:28.375214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:28.383754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.384205 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.384997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:28.385635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:28.492215 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:28.503968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bd5d6ec3-0dec-4ce8-a730-8be88d5a9721 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.433722 Nov 13 07:49:28.504612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 111/204] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:28 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:28.562132 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8e945843-520a-42c1-848e-d76cd062db3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 27647 microversion: 2.1 time: 0.204203 Nov 13 07:49:28.563576 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 94/205] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:28 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 27647 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:29.226524 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:29.227591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:29.239447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.240187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.241122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.241695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.382847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:29.384597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:29.395492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.395902 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.396819 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.397412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.527606 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-82c08650-abd9-4064-8550-a851b288737b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 27033 microversion: 2.20 time: 0.164094 Nov 13 07:49:29.542316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 95/206] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:29 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 27033 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:29.573290 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:29.573999 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:29.598960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.599413 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.600213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.601293 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.845910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:29.850451 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:29.855630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-18790edd-fd4b-43b6-95e1-cd2b8ed25e16 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.311325 Nov 13 07:49:29.856240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 96/207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:29 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:29.867518 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:29.867908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c5b25be0-87ed-4d8e-854b-e2397e0c1b32 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.654022 Nov 13 07:49:29.868534 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 112/208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:29 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:29.868660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:29.876222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.876627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:29.877968 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:29.878595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.001502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8d7fd1e1-d74b-4bfb-beb2-ea2d6c8dc7dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28023 microversion: 2.1 time: 0.143853 Nov 13 07:49:30.003067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 97/209] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:29 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28023 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:30.548328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:30.554709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:30.578118 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.585170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.586804 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.592313 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.796321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7eb37401-a1d2-4d17-a58d-6f5860d2ff65 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 27575 microversion: 2.20 time: 0.259136 Nov 13 07:49:30.799480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 113/210] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:30 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 27575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:30.861144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-f9b9b301-a31e-4252-929c-42be9d2f03f3 req-c0b18211-3362-41f2-9421-c209985cfb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9", "tag": "74c33848-80cd-4dad-9e44-62fc6557bdbc"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:30.868014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:30.868014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:49:30.877638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-f9b9b301-a31e-4252-929c-42be9d2f03f3 req-c0b18211-3362-41f2-9421-c209985cfb4d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.878558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-f9b9b301-a31e-4252-929c-42be9d2f03f3 req-c0b18211-3362-41f2-9421-c209985cfb4d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.885545 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:30.886247 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:30.894468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.894934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.895429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-f9b9b301-a31e-4252-929c-42be9d2f03f3 req-c0b18211-3362-41f2-9421-c209985cfb4d service nova] Creating event network-changed:74c33848-80cd-4dad-9e44-62fc6557bdbc for instance fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 on hv-cinder-81783 Nov 13 07:49:30.895707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.896134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.899842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-f9b9b301-a31e-4252-929c-42be9d2f03f3 req-c0b18211-3362-41f2-9421-c209985cfb4d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050160 Nov 13 07:49:30.900741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 98/211] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:30.911310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:30.911992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:30.922884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.926873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:30.926873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:30.926873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:31.231644 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:31.247751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-608ece54-871b-4c16-af40-749d559089cc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.345060 Nov 13 07:49:31.250318 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 99/212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:30 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:31.269587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:31.271758 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:31.279752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:31.280485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:31.281622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:31.282270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:31.428282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ac5eaa48-9e38-42bd-8f9b-e4078ad7de39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28194 microversion: 2.1 time: 0.176081 Nov 13 07:49:31.429856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 100/213] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:31 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28194 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:31.520484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:31.535287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d28c0a0f-baea-4729-aed7-19b64cc54b14 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.665791 Nov 13 07:49:31.542442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 114/214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:30 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:31.818288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:31.819333 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:31.834255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:31.834732 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:31.835522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:31.835951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:31.978809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5958a015-0d7f-4742-989d-c1835398aacd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 27875 microversion: 2.20 time: 0.172457 Nov 13 07:49:31.979552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 101/215] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:31 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 27875 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:32.284260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:32.284260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:32.284760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.284840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.285798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.286232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.451554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:32.452669 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:32.462653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.463130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.463920 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.464355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.541418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:32.552183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fc542a5b-f84c-4cc7-b940-2daf0b880ca4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.290523 Nov 13 07:49:32.553213 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 115/216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:32 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:32.573072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:32.573681 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:32.581292 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.581733 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.582563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:32.583017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:32.629409 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f4eea155-7582-48d4-a328-f0b0e5945170 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28485 microversion: 2.1 time: 0.193062 Nov 13 07:49:32.633300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 102/217] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:32 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28485 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:32.801476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:32.814524 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8e3982d7-b4e1-446b-94fd-38e4da22c0df tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.255129 Nov 13 07:49:32.814524 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 116/218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:32 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:32.997795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:32.998837 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:33.007011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.007595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.008382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.008817 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.132808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-78070f8d-1c8b-47cd-a5c3-62c90b566742 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28185 microversion: 2.20 time: 0.145416 Nov 13 07:49:33.133522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 103/219] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:32 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:33.574450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:33.575634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:33.583710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.584358 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.585303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.585883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.646806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:33.647815 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:33.656301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.656746 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.657519 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.658118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.813152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-146751e7-ac3b-4f40-9605-c6a14c4dfddc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28608 microversion: 2.1 time: 0.176390 Nov 13 07:49:33.817676 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 104/220] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:33 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28608 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:33.832785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:33.847555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:33.855707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.856205 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.865256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:33.866149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:33.866439 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:33.877561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-06735dfd-9f3f-4794-b677-caa9de8dc79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.312320 Nov 13 07:49:33.878445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 117/221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:33 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:34.081839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:34.090330 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-eb4fb05a-a355-4521-81c0-0ac85bbffb09 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.267142 Nov 13 07:49:34.090898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 105/222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:33 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:34.151099 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:34.152149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:34.161488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.161986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.162819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.163561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.275111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3d8d5a62-b99d-4e27-aece-e1f44c9b1433 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28185 microversion: 2.20 time: 0.134080 Nov 13 07:49:34.279025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 118/223] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:34 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:34.833233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:34.840220 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:34.844092 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.844547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.845332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.845819 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.903022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:34.903725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:34.916769 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.917002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.918440 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:34.918904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:34.974997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8b706147-a487-41c6-9df1-f6b5e486da95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28653 microversion: 2.1 time: 0.150025 Nov 13 07:49:34.977088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 106/224] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:34 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:35.116093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:35.118197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:35.127898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:35.128619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:35.129605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:35.130224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:35.143557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:35.160647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c3ddb09a-8810-41df-bf7b-ae6cc6be8d8f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.266228 Nov 13 07:49:35.161057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 119/225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:34 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:35.296559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:35.300890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:35.315466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:35.316060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:35.316926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:35.317650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:35.455683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:35.456609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a981af00-971c-4b33-ac36-1b80beb2c7b7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28476 microversion: 2.20 time: 0.173289 Nov 13 07:49:35.457702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 120/226] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:35 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:35.465095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-823f632f-debf-439c-a73b-cae8363e4a82 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.360809 Nov 13 07:49:35.465731 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 107/227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:35 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:35.995787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:35.997709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:36.007308 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.008021 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.008974 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.009552 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.133793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c1ccd034-02ec-4b56-a204-4a53aca21d53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28653 microversion: 2.1 time: 0.149789 Nov 13 07:49:36.134657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 121/228] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:35 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28653 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:36.183275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:36.183879 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:36.192108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.192553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.193326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.193757 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.425975 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:36.434804 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c2cfdd81-e015-42db-83dc-3147c7b41d61 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.261152 Nov 13 07:49:36.435349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 108/229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:36 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:36.475496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:36.476621 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:36.485094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.485749 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.487185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.487689 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.489650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:36.490407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:36.498230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.498866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.499794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.500373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.662490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-287e67dc-6f5a-4920-8f8f-8c4b3b5b66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28527 microversion: 2.20 time: 0.197425 Nov 13 07:49:36.664006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 122/230] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:36 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:36.739626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:36.757583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c51bf4be-a3cc-4fa1-aaf3-b9d8a631c034 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.278887 Nov 13 07:49:36.758134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 109/231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:36 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:36.762244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ec471e9f-3e88-454e-954e-b4e24541aee3 req-f9b38a49-7a27-4591-99ed-8630c9c8335d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9", "name": "network-vif-plugged", "status": "completed", "tag": "74c33848-80cd-4dad-9e44-62fc6557bdbc"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:36.771381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:36.771381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:49:36.781152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ec471e9f-3e88-454e-954e-b4e24541aee3 req-f9b38a49-7a27-4591-99ed-8630c9c8335d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:36.781729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ec471e9f-3e88-454e-954e-b4e24541aee3 req-f9b38a49-7a27-4591-99ed-8630c9c8335d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:36.798596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ec471e9f-3e88-454e-954e-b4e24541aee3 req-f9b38a49-7a27-4591-99ed-8630c9c8335d service nova] Creating event network-vif-plugged:74c33848-80cd-4dad-9e44-62fc6557bdbc for instance fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 on hv-cinder-81783 Nov 13 07:49:36.804441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ec471e9f-3e88-454e-954e-b4e24541aee3 req-f9b38a49-7a27-4591-99ed-8630c9c8335d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054587 Nov 13 07:49:36.805069 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 123/232] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:49:37.152788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:37.154702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:37.163381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.164166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.165451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.166043 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.287063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2cac23c5-541c-43e9-a5ff-637cbf14c294 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 28653 microversion: 2.1 time: 0.144394 Nov 13 07:49:37.288686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 110/233] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:37 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 28653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:37.458291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:37.459015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:37.471716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.472233 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.473220 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.473710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.686708 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:37.690564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:37.707891 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.708340 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.731361 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.731981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.738280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:37.761600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2411a5d2-2f20-4e05-9cba-25c378a1ccc2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.313637 Nov 13 07:49:37.775242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 124/234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:37 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:37.791162 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:37.796432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:37.815500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.816859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.817735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:37.818174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:37.875881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0db40fca-b185-42d0-9b9a-7428c9afff52 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28643 microversion: 2.20 time: 0.204136 Nov 13 07:49:37.882467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 111/235] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:37 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28643 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:38.051082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:38.059286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-23f507b6-e5be-4300-a46f-9b516e475dc7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.282777 Nov 13 07:49:38.059827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 125/236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:37 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:38.307029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:38.308154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:38.316291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.319276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:38.319276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.319276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:38.440334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1421ab3f-c0c1-4956-a121-07ecae2adf58 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 29218 microversion: 2.1 time: 0.143818 Nov 13 07:49:38.441080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 112/237] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:38 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 29218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:38.789662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:38.790473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:38.814127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.816079 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:38.816990 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.818713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:38.910850 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:38.912596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:38.921282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.924415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:38.927596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:38.929168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:39.070652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ff8e2152-0a3e-4b87-9003-e7b97f1b53e3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28643 microversion: 2.20 time: 0.184281 Nov 13 07:49:39.073153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 113/238] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:38 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28643 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:39.084686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:39.085631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:39.093635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:39.094049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:39.094877 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:39.095305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:39.128591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:39.136784 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-73bc8a3d-25e7-4bb1-aa40-f310c00217be tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1318 microversion: 2.1 time: 0.360450 Nov 13 07:49:39.137317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 126/239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:38 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:39.320140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:39.329823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-040e1709-c62a-4ed5-bf2e-9c4ad4c2aaa2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.255159 Nov 13 07:49:39.330590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 114/240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:39 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:39.457812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:39.458900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:39.466442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:39.467011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:39.467866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:39.468369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:39.793121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f0929723-6253-441f-8299-9f613af7339b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 30725 microversion: 2.1 time: 0.344992 Nov 13 07:49:39.797322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 127/241] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:39 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 30725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:40.050264 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-9881605", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "0e696668-3fa5-450f-a62d-42f1dbe4c6f1"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:40.091205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:40.092608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:40.102017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.102762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.104561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.105910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.130874 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] validate_networks() for [('0e696668-3fa5-450f-a62d-42f1dbe4c6f1', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:49:40.227782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-77ac41f2-f2c7-4345-9785-00532414766b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28643 microversion: 2.20 time: 0.147404 Nov 13 07:49:40.228438 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 128/242] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:40 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28643 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:40.239532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:40.250840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:40.250840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.250840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.250840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.251718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.468910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:40.477012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-df1b8dfe-772f-44f9-b73e-48ddb002ea72 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1507 microversion: 2.1 time: 0.247474 Nov 13 07:49:40.477591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 129/243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:40 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:40.487556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:40.488160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:40.495924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.502471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.502471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.502471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.795392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:40.804783 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b099a413-0401-4fea-9d62-33438b658f7f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1521 microversion: 2.1 time: 0.326105 Nov 13 07:49:40.805532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 130/244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:40 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:40.828142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:40.829137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:40.836842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.837398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.839112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.839870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.873660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:49:40.874173 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:49:40.874963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:49:40.875640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:49:40.876183 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:49:40.885401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.885943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.887025 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:40.887529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:40.905399 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Getting quotas for project 1157f51a4ae044748780b6818d3bef86. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:49:40.912771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Getting quotas for user 457263d3a89f452bb9faeb4becd60a75 and project 1157f51a4ae044748780b6818d3bef86. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:49:40.923422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:49:40.926357 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:49:40.997631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-71b87882-506c-4984-95d9-c425690d84d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 31954 microversion: 2.1 time: 0.181319 Nov 13 07:49:41.005382 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 131/245] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:40 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 31954 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:41.168411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1629374b-6385-4aef-b62e-4256a4e92402 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.127500 Nov 13 07:49:41.169686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 115/246] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:49:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:49:41.187460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fd9ef71e-1c97-4f40-9878-6635e767ce73 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:41.188746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fd9ef71e-1c97-4f40-9878-6635e767ce73 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:41.254941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:41.255941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:41.274411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:41.275511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:41.275678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:41.276286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:41.305342 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fd9ef71e-1c97-4f40-9878-6635e767ce73 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:41.312671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fd9ef71e-1c97-4f40-9878-6635e767ce73 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1216 microversion: 2.1 time: 0.136019 Nov 13 07:49:41.314722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 132/247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:41 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:41.395826 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ba1f26c8-fedc-4dff-b954-64e1533c9ca0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28643 microversion: 2.20 time: 0.158045 Nov 13 07:49:41.396464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 116/248] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:41 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28643 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:41.833048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:41.833048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:41.836579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:41.837078 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:41.837856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:41.838282 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.019984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:42.021733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:42.030553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.031168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.031982 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.032492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.072606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:42.081244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7225825c-547d-4b95-ab10-b8876a8d4c9c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1501 microversion: 2.1 time: 0.263846 Nov 13 07:49:42.081780 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 133/249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:41 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:42.103232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:42.104470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:42.112262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.112823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.113705 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.114238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.154847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae82f739-79b8-41ce-914f-488808fe948b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 33202 microversion: 2.1 time: 0.147275 Nov 13 07:49:42.158880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 117/250] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:42 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 33202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:42.331333 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:42.335709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5a3a6240-df6e-494b-9d04-ab0bfe935e65 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:42.336415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5a3a6240-df6e-494b-9d04-ab0bfe935e65 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:42.346105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-24a3b02e-2d49-46f4-860c-d01a2458d22b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1515 microversion: 2.1 time: 0.252846 Nov 13 07:49:42.346655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 134/251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:42 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:42.413563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:42.414541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:42.422611 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.423309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.424624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:42.425048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:42.429024 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5a3a6240-df6e-494b-9d04-ab0bfe935e65 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:42.438107 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5a3a6240-df6e-494b-9d04-ab0bfe935e65 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1216 microversion: 2.1 time: 0.112363 Nov 13 07:49:42.438853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 118/252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:42 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:42.550172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-94abb128-e22e-4e50-8540-013d957d7b6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 28643 microversion: 2.20 time: 0.144365 Nov 13 07:49:42.551856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 135/253] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:42 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 28643 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:43.173809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:43.177862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:43.187215 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.187817 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.188775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.189467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.295855 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b151d86e-a82c-4949-87a6-898def62abc4"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:43.297316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:43.306545 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.306805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.307736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.308179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.340125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2a67e357-06ca-44be-84b4-7b18e8a86a29 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 33848 microversion: 2.1 time: 0.175852 Nov 13 07:49:43.343837 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 119/254] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:43 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 33848 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:43.462473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:43.463202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:43.471218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.480921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.480921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.480921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.598003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:43.606453 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-91ac732b-3363-41da-9613-1f9551c5719e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1268 microversion: 2.1 time: 0.154248 Nov 13 07:49:43.610108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 120/255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:43 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:43.621374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:43.622306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:43.630340 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.630831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.631622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:43.632055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:43.784364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-967495ab-cf3a-4a5f-aa19-31df7eaa6d14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 29949 microversion: 2.20 time: 0.174965 Nov 13 07:49:43.785219 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 121/256] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:43 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 29949 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:44.359727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:44.361652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:44.369749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.370214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.371063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.371493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.502875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-18176a21-7be5-4559-9cf6-152b4a9a2454 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 34788 microversion: 2.1 time: 0.152978 Nov 13 07:49:44.503895 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 122/257] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:44 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 34788 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:44.515886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:44.517673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:44.525225 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.525674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.526448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.526901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.591573 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lazy-loading 'flavor' on Instance uuid 8908876f-0fbb-43e5-861d-16599dc0dbf8 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:49:44.732639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3b33b26e-8df1-4600-9a75-3f9dde86bc2c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.449971 Nov 13 07:49:44.734134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 136/258] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:49:43 2021] POST /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 194 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:49:44.775419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:44.776150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:44.787835 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.793236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.793236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:44.793236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:44.967992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:44.981567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ad53de43-5678-43d4-b401-a2df1eeb4cf7 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1274 microversion: 2.1 time: 0.246005 Nov 13 07:49:44.984012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 137/259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:44 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:44.998420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:44.999988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:45.008287 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6ee05101-bd4d-44cf-a129-06cca48beb29 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action" status: 200 len: 32 microversion: 2.1 time: 0.501849 Nov 13 07:49:45.010712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 123/260] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:44 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action => generated 32 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:49:45.011261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.011918 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.012924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.014435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.027449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:45.028345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:45.038054 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.038609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.040267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.041408 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.163618 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-30791b8f-6f7d-479b-b6ab-6677dec97df3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 31765 microversion: 2.20 time: 0.177496 Nov 13 07:49:45.164553 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 138/261] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:44 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 31765 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:45.317362 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:45.325572 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9634eeb6-0266-4b0f-8ac5-d3d4a8c7c0ba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.310230 Nov 13 07:49:45.326040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 124/262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:45 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:45.521269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:45.522296 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:45.530193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.530645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.531463 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:45.531904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:45.652615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e6489871-2747-447b-ae24-e5fac8eaf2d0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 35595 microversion: 2.1 time: 0.141206 Nov 13 07:49:45.653402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 139/263] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:45 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 35595 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:46.011865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:46.013396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:46.024511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.025334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.026383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.027072 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.183929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:46.185061 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:46.193443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.194138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.195187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.195961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.333134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-aa07c315-d997-4096-a8b8-a8356c446f4c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 32887 microversion: 2.20 time: 0.160230 Nov 13 07:49:46.334520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 140/264] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:46 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 32887 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:46.351276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:46.352690 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:46.365308 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.366147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.367239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.368056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.543257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:46.551905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-115eb6f4-06e9-4863-a202-01e7a2f46e46 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.552503 Nov 13 07:49:46.562220 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 125/265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:45 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:46.670571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:46.671555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:46.678788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.679465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.680006 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:46.680430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:46.729322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:46.739519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cb3caed6-c0ff-4c40-8b40-749e6e4f9ed3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.400794 Nov 13 07:49:46.740653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 141/266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:46 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:46.818441 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0282c1ed-46d6-42b9-aabc-79094442095e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 36719 microversion: 2.1 time: 0.152228 Nov 13 07:49:46.818441 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 126/267] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:46 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 36719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:47.352036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:47.352880 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:47.360542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.361637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.362599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.363070 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.486942 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-78d871c3-21dc-4546-94fc-b3ea730fb687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 33497 microversion: 2.20 time: 0.143941 Nov 13 07:49:47.493575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 142/268] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:47 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 33497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:47.497755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-5fe190da-414e-45c4-871b-7c0f9b97c2bf req-6e78016b-2235-4b82-917f-366357116eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce8f454-3e4d-4595-862a-cd01f1c66589", "tag": "3523002e-6b2e-4520-942e-63bd11ed422e"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:47.505863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:47.505863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:49:47.515367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-5fe190da-414e-45c4-871b-7c0f9b97c2bf req-6e78016b-2235-4b82-917f-366357116eb5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.516003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-5fe190da-414e-45c4-871b-7c0f9b97c2bf req-6e78016b-2235-4b82-917f-366357116eb5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.536348 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-5fe190da-414e-45c4-871b-7c0f9b97c2bf req-6e78016b-2235-4b82-917f-366357116eb5 service nova] Creating event network-changed:3523002e-6b2e-4520-942e-63bd11ed422e for instance 0ce8f454-3e4d-4595-862a-cd01f1c66589 on hv-cinder-81783 Nov 13 07:49:47.542479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-5fe190da-414e-45c4-871b-7c0f9b97c2bf req-6e78016b-2235-4b82-917f-366357116eb5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053149 Nov 13 07:49:47.542632 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 127/269] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:47.577635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:47.578664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:47.589051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.589761 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.590747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.591541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.763695 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:47.764477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:47.772448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.772978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.774053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:47.774693 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:47.989221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:47.997579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-92822b29-9731-46a3-b62e-84b6178d7f13 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.243725 Nov 13 07:49:47.998335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 128/270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:47 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:48.008968 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:48.009962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:48.017247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:48.017883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:48.018856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:48.019295 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:48.150901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3df4b040-9970-476e-9940-7e0879a859e2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 38042 microversion: 2.1 time: 0.151021 Nov 13 07:49:48.151549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 129/271] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:47 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 38042 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:48.326746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:48.336452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9b1ec129-3d3e-4886-9a92-ed40899dafdb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.771078 Nov 13 07:49:48.337011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 143/272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:47 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:48.505205 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:48.506838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:48.514846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:48.515520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:48.516458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:48.517604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:48.660846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-adfd1cbe-104d-4bc2-9926-ba665adfeff6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 34195 microversion: 2.20 time: 0.165548 Nov 13 07:49:48.661599 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 130/273] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:48 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 34195 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:49.022039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:49.022657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:49.030629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.031114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.032065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.032505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.169438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:49.170585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:49.180171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.180624 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.181445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.181824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.245517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:49.254413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-323cb45b-2be7-4481-88ca-d51e7aa13bb0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.242862 Nov 13 07:49:49.256656 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 144/274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:49 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:49.331922 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-644bc6d9-7450-4eb9-a89c-1cbc4f5a75ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 38175 microversion: 2.1 time: 0.172707 Nov 13 07:49:49.332600 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 131/275] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:49 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 38175 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:49.358865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:49.359867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:49.367871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.368318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.369096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.369526 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.678188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:49.678899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:49.679909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:49.687959 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.688408 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.689039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f584d085-505d-499e-b772-c073d0188cdd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.338945 Nov 13 07:49:49.689228 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:49.689664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:49.690551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 145/276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:49 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:49.817440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-96abc43c-3128-4ba3-aa44-ec0ab5239b61 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 34970 microversion: 2.20 time: 0.148407 Nov 13 07:49:49.818702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 132/277] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:49 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 34970 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:50.276651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:50.277230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:50.284360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.285208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.285619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.286059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.350550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:50.351584 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:50.360013 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.360458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.361239 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.361675 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.481210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b3e4d9ee-687b-4b6a-8c98-15d9576fd1cb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 38175 microversion: 2.1 time: 0.140474 Nov 13 07:49:50.482577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 133/278] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:50 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 38175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:49:50.508460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:50.518415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-57cd91ec-8e10-4109-81fb-55405071a24e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.251583 Nov 13 07:49:50.519590 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 146/279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:50 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:50.712615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:50.713314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:50.721416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.721921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.722789 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.723227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.838530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:50.838530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:50.845959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.846449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.847264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:50.847704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:50.951042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:50.959333 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-15686b81-8eea-4936-887e-50a5983840b0 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.256416 Nov 13 07:49:50.960043 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 134/280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:50 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:50.991067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ae864227-be6f-4398-b761-dc3e4253119f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 35929 microversion: 2.20 time: 0.165249 Nov 13 07:49:50.993450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 147/281] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:50 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 35929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:51.500309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:51.501230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:51.508651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.509336 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.510129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.510564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.542249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:51.543556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:51.551803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.552463 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.553399 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.553970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.683475 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9817de0c-9913-4998-803d-cb995c799a10 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 200 len: 38306 microversion: 2.1 time: 0.193590 Nov 13 07:49:51.684354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 135/282] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:49:51 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 38306 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:51.701264 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:51.702146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:51.711111 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.711824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.712824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.713849 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.791855 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:51.792923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-62c3a185-9c9a-4ef6-bc3b-2d45090d316c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/ips" status: 200 len: 147 microversion: 2.1 time: 0.101806 Nov 13 07:49:51.793830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 136/283] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:49:51 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/ips => generated 147 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:49:51.800658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-54cb386c-3b29-4f3d-af0f-ca0212a3a4a4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.268765 Nov 13 07:49:51.802705 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 148/284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:51 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:51.980738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:51.981351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:51.989090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.989681 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:51.990570 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:51.991095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.009133 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:52.010056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:52.017841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:52.018294 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.019119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:52.019664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.151620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6a87431b-5f09-4d6e-8a1a-5a8981896907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 36806 microversion: 2.20 time: 0.152312 Nov 13 07:49:52.153107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 149/285] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:51 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 36806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:49:52.255720 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:52.264596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3174dfa2-a05e-4b74-87ab-5427ffbd41c5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.292979 Nov 13 07:49:52.266711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 137/286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:51 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:52.800040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-1f62443d-db2d-49af-87f6-132c9b96233a req-1a159233-7b7b-4de2-9ddb-1afc2cbfd1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce8f454-3e4d-4595-862a-cd01f1c66589", "name": "network-vif-plugged", "status": "completed", "tag": "3523002e-6b2e-4520-942e-63bd11ed422e"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:52.808480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:49:52.808480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:49:52.821122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-1f62443d-db2d-49af-87f6-132c9b96233a req-1a159233-7b7b-4de2-9ddb-1afc2cbfd1c2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:52.822053 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-1f62443d-db2d-49af-87f6-132c9b96233a req-1a159233-7b7b-4de2-9ddb-1afc2cbfd1c2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.825435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:52.826040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:52.837398 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:52.838143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.839216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:52.839658 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:52.842270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-1f62443d-db2d-49af-87f6-132c9b96233a req-1a159233-7b7b-4de2-9ddb-1afc2cbfd1c2 service nova] Creating event network-vif-plugged:3523002e-6b2e-4520-942e-63bd11ed422e for instance 0ce8f454-3e4d-4595-862a-cd01f1c66589 on hv-cinder-81783 Nov 13 07:49:52.848754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-1f62443d-db2d-49af-87f6-132c9b96233a req-1a159233-7b7b-4de2-9ddb-1afc2cbfd1c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058705 Nov 13 07:49:52.850051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 150/287] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:49:53.093375 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:53.102605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-12e083f9-ef49-4abd-a66b-1fe373af0069 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.288710 Nov 13 07:49:53.102886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 138/288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:52 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:53.170732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:53.171738 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:53.179143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:53.179597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:53.180374 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:53.180813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:53.287525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:53.288382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:53.297444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:53.298204 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:53.299354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e78e5fe9-5a11-435a-8f7a-f44f6b7da70c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 37910 microversion: 2.20 time: 0.137766 Nov 13 07:49:53.299480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:53.300052 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:53.300200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 151/289] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:53 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 37910 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:53.519527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:53.527947 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-34c4f00a-c1d1-4ad4-b72a-761aec1209a5 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.250375 Nov 13 07:49:53.528571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 139/290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:53 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:54.125561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:54.126292 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:54.134661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.136741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.136741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.137046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.142353 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1702058003", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "13dc6fb3-9bcb-4e4a-8416-084631603788"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:54.222169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] validate_networks() for [('13dc6fb3-9bcb-4e4a-8416-084631603788', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:49:54.384208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:54.394027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d8132e45-2685-4761-8e47-bec99a34da73 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.277542 Nov 13 07:49:54.394027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 152/291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:54 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:54.404389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:54.405304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:54.414702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.415152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.415978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.416408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.542625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6c8046cb-50a5-4528-be59-90bed4dd7f56 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 38196 microversion: 2.20 time: 0.147607 Nov 13 07:49:54.543419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 153/292] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:54 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 38196 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:54.557921 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:54.559332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:54.568062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.568808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.570059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.570691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.839201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:54.847209 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3c55fa1b-11c4-4134-9454-3b6a3d8c33b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1316 microversion: 2.1 time: 0.302673 Nov 13 07:49:54.847736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 154/293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:54 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:54.898568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:49:54.899025 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:49:54.899503 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:49:54.899922 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:49:54.900338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:49:54.911546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.921640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.921640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:54.921640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:54.933870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:49:54.937984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for user e0728501bcf8493a8704d5ca9f4dadf0 and project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:49:54.950041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:49:54.952424 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:49:55.034746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83118019-f4a1-4453-9272-19a8fd6b1584"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:55.035792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:55.042877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.043322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.044075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.044508 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.158100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c38b0f8f-84ed-4888-852f-d99300b4ac7d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026112 Nov 13 07:49:55.159081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 140/294] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:49:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:49:55.182809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-890bc225-2b1b-4576-8b4f-f9076ad9b3a6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:55.183499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-890bc225-2b1b-4576-8b4f-f9076ad9b3a6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:55.267163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-890bc225-2b1b-4576-8b4f-f9076ad9b3a6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:55.275392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-890bc225-2b1b-4576-8b4f-f9076ad9b3a6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1218 microversion: 2.1 time: 0.109905 Nov 13 07:49:55.275945 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 141/295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:55 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:55.416299 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:55.416915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:55.425705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.428499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.428499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.428499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.712394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:55.721279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-306d4777-ca35-4f3c-98ef-9e1561cacdb6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.315821 Nov 13 07:49:55.721978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 142/296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:55 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:55.742163 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:55.743141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:55.750137 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.751771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.751771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.751998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.857997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6d95d0dd-a647-441b-b732-b4388d4a66a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 38196 microversion: 2.20 time: 0.125395 Nov 13 07:49:55.859436 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 143/297] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:55 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 38196 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:55.870233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:55.870951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:55.878919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.879563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:55.880230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:55.880665 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.129659 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:56.138199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5737d3e0-1ded-4115-b2f5-5add6e1cac94 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1504 microversion: 2.1 time: 0.277579 Nov 13 07:49:56.138910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 144/298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:55 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:56.298161 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:56.298798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:56.306376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.307797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.307797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.308227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.335135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0a5b60a4-ae4c-4381-af32-c60f12a2ff87 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.309129 Nov 13 07:49:56.336908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 155/299] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:49:55 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:49:56.457875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:56.477180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5a9c2800-5b0b-41a4-a204-e7dab76fd388 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1222 microversion: 2.1 time: 0.187535 Nov 13 07:49:56.478345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 145/300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:56 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:56.745845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:56.746539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:56.755840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.756290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.757137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.757566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.875074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:49:56.875990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:56.884904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.885571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.886345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:56.886802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:56.976925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:56.985127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a32b5ee-8cae-49fe-a272-20b4d3ffea41 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.249820 Nov 13 07:49:56.986310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 156/301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:56 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:49:57.499579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:57.500174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:57.507836 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:57.508333 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:57.508825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:57.509265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:57.780427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:57.788347 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0958d232-8ff4-4713-825b-62a0dde52505 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1214 microversion: 2.1 time: 0.297927 Nov 13 07:49:57.788917 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 157/302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:57 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:58.011640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:58.012244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:58.019929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:58.020377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:58.021144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:58.021576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:58.224080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:58.232578 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5ff4cd88-a72c-4ab4-9c1a-343492b6fc0e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.230060 Nov 13 07:49:58.233109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 158/303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:58 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:58.810575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:58.815551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:58.819668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:58.820218 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:58.820954 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:58.821381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:58.951542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:58.960042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-28d000d6-4743-4aba-982c-65a9dfb9ee8a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1214 microversion: 2.1 time: 0.158636 Nov 13 07:49:58.960556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 159/304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:58 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:59.256479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:59.257061 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:59.264114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.264571 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:59.265349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.265786 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:59.390079 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7e0df43c-ce7c-4bdf-89ad-a58b2168d1fd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 200 len: 38339 microversion: 2.20 time: 2.524107 Nov 13 07:49:59.391262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 146/305] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:49:56 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 38339 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:49:59.428144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:59.428899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:59.446167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.446167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:59.446167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.446167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:59.576932 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-43c81891-2517-4f92-aec6-198de2432115 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/ips" status: 200 len: 150 microversion: 2.20 time: 0.177922 Nov 13 07:49:59.578078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 147/306] 10.222.0.32 () {60 vars in 1288 bytes} [Sat Nov 13 07:49:59 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/ips => generated 150 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:49:59.623169 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:49:59.634318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0dd4bffb-d873-4c4d-a638-97b441b04338 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.387251 Nov 13 07:49:59.635110 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 160/307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:59 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:49:59.981942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:49:59.982838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:49:59.991001 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.991458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:49:59.992245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:49:59.992685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:00.152638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:00.162596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8d907ae1-47cd-46ad-9921-747a0bf83a9c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1270 microversion: 2.1 time: 0.189491 Nov 13 07:50:00.175419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 148/308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:49:59 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:00.660609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:00.667345 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:00.686845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:00.687559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:00.695745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:00.696418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:01.189938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:01.190649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:01.217189 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:01.218380 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:01.219548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:01.220606 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:01.250506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:01.273228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1fbeee88-8f4e-414e-bc7d-da252497b84a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.625301 Nov 13 07:50:01.283222 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 161/309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:00 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:01.458822 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:01.467422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3477fe27-e2a9-4041-bb1b-11db6ae2b908 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1276 microversion: 2.1 time: 0.288743 Nov 13 07:50:01.468040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 149/310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:01 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1276 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:02.294511 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:02.295724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:02.303313 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:02.303996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:02.304948 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:02.305572 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:02.491701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:02.492306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:02.505473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:02.505473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:02.505473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:02.505473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:02.766207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:02.777232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f6ce8a5a-b9e3-48d2-b0d5-80abd56c4743 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.491621 Nov 13 07:50:02.778076 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 162/311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:02 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:02.804696 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:02.815070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-53763f39-f5f6-4c47-a39e-bb1a5b06e763 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.334074 Nov 13 07:50:02.815354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 150/312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:02 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:03.000289 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:03.001363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:03.033830 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.035758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.036726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.037319 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.115797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lazy-loading 'flavor' on Instance uuid 10558cad-5f50-40b7-b4e0-367f83693f74 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:50:03.605807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-12c108c8-37d7-4236-a1da-0d37306ad06d req-0890b5c1-45c8-4717-8b71-df4ef6f6025f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ca8361-d649-4c86-9bb0-3dd0bd8b241d", "tag": "8307707c-10a8-4d30-9b1c-b1f8a02ce5af"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:03.613898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:03.613898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:50:03.625896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-12c108c8-37d7-4236-a1da-0d37306ad06d req-0890b5c1-45c8-4717-8b71-df4ef6f6025f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.627294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-12c108c8-37d7-4236-a1da-0d37306ad06d req-0890b5c1-45c8-4717-8b71-df4ef6f6025f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.643433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-12c108c8-37d7-4236-a1da-0d37306ad06d req-0890b5c1-45c8-4717-8b71-df4ef6f6025f service nova] Creating event network-changed:8307707c-10a8-4d30-9b1c-b1f8a02ce5af for instance f5ca8361-d649-4c86-9bb0-3dd0bd8b241d on hv-cinder-81783 Nov 13 07:50:03.648037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-12c108c8-37d7-4236-a1da-0d37306ad06d req-0890b5c1-45c8-4717-8b71-df4ef6f6025f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064615 Nov 13 07:50:03.648932 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 151/313] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:03.802774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:03.803389 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:03.810955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.811412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.812210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.812664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.828367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-eb6c77a4-5ba0-4286-9de4-4a7666a7fb41 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 202 len: 0 microversion: 2.20 time: 0.846180 Nov 13 07:50:03.829290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 163/314] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:50:02 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:50:03.841750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:03.842717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:03.850960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.851419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:03.860234 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:03.860681 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.067042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:04.085265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9527ca99-1c13-4cea-8aee-0af47b2d931c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1501 microversion: 2.1 time: 0.292532 Nov 13 07:50:04.090881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 152/315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:03 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:04.109773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:04.110611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:04.119516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.120134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.121108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.122888 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.396610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:04.402395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cff9fcc5-4d01-4fe2-b483-1aed612b937a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.571652 Nov 13 07:50:04.403106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:04.413273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 164/316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:03 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:04.418610 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:04.425199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28fcf9e6-882b-48d8-91b4-2df8fdb912db"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:04.426372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:04.426985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:04.428244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fd0acb66-3337-4ea6-a3f5-9296e1f47125 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.336144 Nov 13 07:50:04.428896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 153/317] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:04 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:04.436056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.436506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.437434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.437875 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.503514 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] HTTP exception thrown: Cannot 'attach_volume' instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 while it is in vm_state rescued Nov 13 07:50:04.504126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Returning 409 to user: Cannot 'attach_volume' instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 while it is in vm_state rescued {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:50:04.504959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5d6273f4-c710-4d78-92ea-4ae43666656c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090420 Nov 13 07:50:04.505490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 165/318] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:50:04 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 13 07:50:04.520286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:04.521076 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:04.528206 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.528654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.534133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.534133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.886737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3a534fdb-a8b2-4445-aa90-5c31210b45d7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.376095 Nov 13 07:50:04.891311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 154/319] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:50:04 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:50:04.902357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:04.903519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:04.911291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.911972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:04.912933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:04.913366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:05.123180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:05.132263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5920ec8a-8c35-454b-851a-5dbef1d9d940 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.240111 Nov 13 07:50:05.132787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 166/320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:04 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:05.425484 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:05.426171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:05.433563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:05.434010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:05.438368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:05.438368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:05.453378 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:05.455096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:05.461597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:05.462303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:05.463204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:05.463860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:05.644349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:05.652703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1eeb2f58-0c46-40e8-a868-6cc9b9ccc2d9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.237694 Nov 13 07:50:05.653879 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 155/321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:05 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:05.684088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:05.697637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:05.703833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:05.705474 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a38a6bf4-1e05-49cd-8b79-f9d0ed581c49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.261419 Nov 13 07:50:05.706024 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 167/322] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:05 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:06.158121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:06.158787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:06.166286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.166760 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.167543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.168103 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.386443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:06.394693 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-25e6fd28-16b0-4b23-bf4a-ab40a871930d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.249091 Nov 13 07:50:06.395311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 156/323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:06 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:06.676383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:06.676982 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:06.684191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.684637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.685404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.685835 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.730165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:06.730704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:06.738681 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.739150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.739927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:06.740363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:06.900383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:06.909196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d631a507-fdf1-495a-83d8-48eb4b4a38b1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.242464 Nov 13 07:50:06.909756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 168/324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:06 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:07.083677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:07.097629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:07.103862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:07.104950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4013a79a-c5a2-4b43-810a-345b6aca13b0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.384653 Nov 13 07:50:07.105476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 157/325] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:06 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:07.417330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:07.418006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:07.425843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:07.426370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:07.427532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:07.428067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:07.633219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:07.641212 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3f8ddd3a-5dff-40c0-bcde-9c4f8401beeb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.233338 Nov 13 07:50:07.641750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 169/326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:07 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:07.933242 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:07.933747 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:07.942651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:07.943124 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:07.943899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:07.944334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:08.129470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:08.130121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:08.137369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:08.137810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:08.138597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:08.139058 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:08.141492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:08.149691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-74f6ecd6-1989-404b-a453-9589c5424e53 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.226150 Nov 13 07:50:08.150225 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 158/327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:07 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:08.497967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:08.511660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:08.519081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:08.520461 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9841ea09-d049-4217-aa3a-0bb04ea2b906 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.400876 Nov 13 07:50:08.534432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 170/328] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:08 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:08.664909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:08.665526 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:08.677285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:08.677285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:08.677285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:08.677285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:08.880550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:08.888551 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7732fb03-444c-454c-8f43-8bb69fc7634d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.233550 Nov 13 07:50:08.889077 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 159/329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:08 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:09.174539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:09.175146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:09.182169 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.182608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:09.183395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.183820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:09.389223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:09.397271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2dca3619-4581-4ef8-ae5d-6f66e7d453c9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.232358 Nov 13 07:50:09.397886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 171/330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:09 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:09.547156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:09.549417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:09.561207 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.561910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:09.563759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.564995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:09.848224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:09.860367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:09.867323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:09.868422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b978769a-d0d4-48f1-a45a-7429747f407c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.332535 Nov 13 07:50:09.868933 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 160/331] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:09 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:09.911239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:09.911848 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:09.919537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.920204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:09.925048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:09.925048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:10.132684 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:10.142785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9c1e56fa-4111-4715-91a9-87d7bca6b845 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.240742 Nov 13 07:50:10.143497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 172/332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:09 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:10.419082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:10.419690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:10.426904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:10.427356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:10.428198 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:10.428631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:10.746432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:10.756363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a4447b00-0967-4a73-95b0-fe4d2a2353ae tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.346860 Nov 13 07:50:10.757268 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 161/333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:10 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:10.892242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:10.892843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:10.899951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:10.902431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:10.902431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:10.902431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:11.165760 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:11.166376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:11.174813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:11.175548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:11.176387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:11.177116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:11.265887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:11.303038 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:11.303933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:11.315185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d58c6edf-8e2a-4bb4-9188-9a595638144c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.422445 Nov 13 07:50:11.326839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 173/334] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:10 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:11.472734 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:11.482627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-aaaa6f92-a0e6-4ee1-97b2-47ed0fd99de8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1509 microversion: 2.1 time: 0.326577 Nov 13 07:50:11.487800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 162/335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:11 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:11.670456 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e59ff799-45bc-4f9e-8ff4-67e7eb73f059 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:11.678519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e59ff799-45bc-4f9e-8ff4-67e7eb73f059 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:11.679794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e59ff799-45bc-4f9e-8ff4-67e7eb73f059 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:11.752582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e59ff799-45bc-4f9e-8ff4-67e7eb73f059 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Going to try to stop instance {{(pid=97388) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Nov 13 07:50:11.779316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:11.780567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:11.791328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:11.792171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:11.793214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:11.793830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.032166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.041574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e17bce0b-b68b-40bf-96ea-fdc1e12b171f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.271286 Nov 13 07:50:12.044227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 163/336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:11 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:12.108235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e59ff799-45bc-4f9e-8ff4-67e7eb73f059 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 202 len: 0 microversion: 2.1 time: 0.447819 Nov 13 07:50:12.113760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 174/337] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:50:11 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:50:12.130566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:12.131211 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:12.146279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.146781 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.151524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.151524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.370725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:12.370725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:12.406334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.407074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.407893 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.408271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.408864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.419244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cd091d90-7722-4430-bab3-251ca6eb9a53 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.305403 Nov 13 07:50:12.420416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 164/338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:12 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:12.510031 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:12.510755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:12.539406 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.551250 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.553410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:12.557440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:12.816201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.840800 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.850201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.852023 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-05731f50-4157-4fd6-b760-9ac37ea2df38 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.520174 Nov 13 07:50:12.853098 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 175/339] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:12 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:12.896122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:12.909558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-14b31262-0453-4155-9e28-efb525eab43d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1515 microversion: 2.1 time: 0.412224 Nov 13 07:50:12.910712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 165/340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:12 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:13.064384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:13.064991 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:13.071966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.072407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:13.073172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.073596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:13.337419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:13.346173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5012f31d-5e80-40bf-bc86-83f10d41a3df tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.290344 Nov 13 07:50:13.346718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 176/341] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:13 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:13.445577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:13.450544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:13.456694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.457191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:13.457998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.458434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:13.710217 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:13.719346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-df5582ff-14fd-40c9-a0c5-618a43e0fffc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.284363 Nov 13 07:50:13.720491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 166/342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:13 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:13.879633 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:13.880252 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:13.887770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.888217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:13.889020 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:13.889455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.103391 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:14.117858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:14.124172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:14.125299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fb0584e8-54ab-484b-83ef-ed563c4a1d76 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.257037 Nov 13 07:50:14.125816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 177/343] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:13 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:14.369699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:14.370307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:14.377890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:14.379512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.379512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:14.379843 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.681539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:14.691762 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c1246267-6311-4491-88d1-4ec6a8f78ba0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.331089 Nov 13 07:50:14.692675 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 167/344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:14 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:14.742793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:14.743554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:14.751417 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:14.751968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.752856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:14.753705 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.887979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-91d152ea-8bb2-45fa-9bd6-a83133072d23 req-bb34ab6d-55fb-4d41-92b7-4c113f487cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ca8361-d649-4c86-9bb0-3dd0bd8b241d", "name": "network-vif-plugged", "status": "completed", "tag": "8307707c-10a8-4d30-9b1c-b1f8a02ce5af"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:14.897876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:14.897876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:50:14.910251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-91d152ea-8bb2-45fa-9bd6-a83133072d23 req-bb34ab6d-55fb-4d41-92b7-4c113f487cbd service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:14.910745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-91d152ea-8bb2-45fa-9bd6-a83133072d23 req-bb34ab6d-55fb-4d41-92b7-4c113f487cbd service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:14.927351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-91d152ea-8bb2-45fa-9bd6-a83133072d23 req-bb34ab6d-55fb-4d41-92b7-4c113f487cbd service nova] Creating event network-vif-plugged:8307707c-10a8-4d30-9b1c-b1f8a02ce5af for instance f5ca8361-d649-4c86-9bb0-3dd0bd8b241d on hv-cinder-81783 Nov 13 07:50:14.934105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-91d152ea-8bb2-45fa-9bd6-a83133072d23 req-bb34ab6d-55fb-4d41-92b7-4c113f487cbd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055762 Nov 13 07:50:14.934909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 168/345] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:50:15.050870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.065309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-81aeaaf4-254e-40e4-9f89-ce69b2335746 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.332495 Nov 13 07:50:15.067742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 178/346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:14 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:15.143029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:15.143745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:15.151689 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.156553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.156553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.156778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:15.156870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.156959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:15.162362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.163557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.164469 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.165051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.416365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.440319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.443807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.448503 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0d9f5f2c-a3d0-442e-ba4a-31a89d7839bb tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1515 microversion: 2.1 time: 0.327792 Nov 13 07:50:15.449033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 169/347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:15 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:15.451394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.452630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-39768157-9e1f-4b3d-a4f7-4a5e4754b073 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.311237 Nov 13 07:50:15.453118 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 179/348] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:15 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:15.469471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6561935-2e76-4d39-8143-6c1c03160d2a"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:15.470608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:15.477943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.478388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.479212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.479641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.713288 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:15.713980 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:15.727315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.727315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.727315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:15.727315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:15.942325 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:15.950302 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-49511d03-42db-43e4-9702-590e9c591f9d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.246539 Nov 13 07:50:15.950844 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 180/349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:15 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:16.089789 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:16.090393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:16.098094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.098568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:16.099407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.099874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:16.317771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:16.326180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bfff77b8-1d7c-4f2a-a334-fed132ccbdf4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.246350 Nov 13 07:50:16.326719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 181/350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:16 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:16.477221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:16.478021 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:16.485647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.487905 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:16.488776 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.489274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:16.645704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-602f5e25-47dd-4918-9589-1ee506c6a700 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184275 Nov 13 07:50:16.647127 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 170/351] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:50:15 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 194 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:16.727052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:16.740853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:16.747498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:16.748636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-633ebf41-cb9f-43c0-9963-888b97bddaf8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.281596 Nov 13 07:50:16.749816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 182/352] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:16 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:16.974445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:16.975105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:16.984697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.985144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:16.986546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:16.987003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:17.222342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:17.230393 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-26e93fcb-ac36-4b8d-aa3e-8cfcefebc820 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1318 microversion: 2.1 time: 0.266983 Nov 13 07:50:17.230948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 171/353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:16 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:17.349104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:17.350226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:17.357574 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:17.359202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:17.359202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:17.359516 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:17.677525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:17.686075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a276be30-4f8a-43cd-8173-c47ccfe1ce3c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.346599 Nov 13 07:50:17.686655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 183/354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:17 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:17.773821 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:17.774428 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:17.781800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:17.782252 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:17.783710 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:17.784148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:17.997749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:18.010941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:18.017350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:18.018447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ff6d2fdd-8b5d-4f5a-a6a8-c7c5302fc5ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.254420 Nov 13 07:50:18.018986 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 172/355] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:17 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:18.253154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:18.253757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:18.260736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.261175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.261934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.262361 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.476772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:18.485185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1f992b61-a164-45f4-a739-58af8c4b753c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1508 microversion: 2.1 time: 0.241096 Nov 13 07:50:18.485845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 184/356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:18 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:18.507605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b151d86e-a82c-4949-87a6-898def62abc4"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:18.508807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:18.519548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.519548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.519548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.519548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.709271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:18.709815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:18.717253 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.717895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.718701 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:18.719329 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:18.944043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:18.954112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-30dfac23-1430-4f5e-9200-2b76629fc463 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.254687 Nov 13 07:50:18.955287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 185/357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:18 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:19.042528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:19.043321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:19.059103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.059561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.060413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.060856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.259371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume b151d86e-a82c-4949-87a6-898def62abc4 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-488a516d-b809-43a0-841d-96c32406af1f) Nov 13 07:50:19.260303 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 400 to user: Invalid input received: Invalid volume: Volume b151d86e-a82c-4949-87a6-898def62abc4 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-488a516d-b809-43a0-841d-96c32406af1f) {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:50:19.261138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2d12d634-1c21-4256-af1a-82bd8b735867 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.763527 Nov 13 07:50:19.261861 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 173/358] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:50:18 2021] POST /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d/os-volume_attachments => generated 279 bytes in 765 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 13 07:50:19.283536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:19.297151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:19.304150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:19.305383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-870e4793-17ce-457a-ae99-cb7d755768ab tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.272199 Nov 13 07:50:19.305889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 186/359] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:19 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:19.375032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:19.375606 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:19.383643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.384086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.384857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.385290 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.826716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0e221ea5-57e8-4697-ba12-eda32c0859e1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments/b151d86e-a82c-4949-87a6-898def62abc4" status: 202 len: 0 microversion: 2.1 time: 0.460707 Nov 13 07:50:19.827626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 174/360] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:50:19 2021] DELETE /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments/b151d86e-a82c-4949-87a6-898def62abc4 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:50:19.850288 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:19.860163 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:19.873091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.873091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.873091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:19.873091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:19.942395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b6618482-c6ee-471f-830d-a56ee0b96266 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108091 Nov 13 07:50:19.942885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 187/361] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:19 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:19.991313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:19.992112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:20.002001 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.002579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:20.020531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.020531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:20.219181 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:20.228069 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5587502f-3295-4e88-93aa-31ece6dd22cd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.247751 Nov 13 07:50:20.228599 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 175/362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:19 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:20.330147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:20.330780 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:20.338790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.339240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:20.340015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.340449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:20.562896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:20.577442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:20.583729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:20.584823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1e50b91f-3fec-4a68-9c2f-193e52551995 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.264392 Nov 13 07:50:20.585362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 188/363] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:20 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:20.961602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:20.961602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:20.968222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.968671 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:20.969578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:20.970519 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:21.045431 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-106da15a-a3a7-4c01-834f-00865d6ee13a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095251 Nov 13 07:50:21.045987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 176/364] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:20 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:21.250389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:21.251064 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:21.261958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:21.261958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:21.261958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:21.261958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:21.478088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:21.486770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1cd1b78b-1a85-4c8d-9345-f33d38fb70e3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.246033 Nov 13 07:50:21.487295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 189/365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:21 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:21.609148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:21.609755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:21.617077 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:21.617529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:21.618310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:21.618830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:21.823983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:21.837875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:21.844150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:21.845176 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6d26de1d-f466-499c-a0d9-3742e536bc3d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.245636 Nov 13 07:50:21.845700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 177/366] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:21 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:22.063005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:22.064557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:22.072063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.072526 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:22.073296 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.073727 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:22.144833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-11c758bc-30a6-492b-97c1-39613d355f89 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091123 Nov 13 07:50:22.145320 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 190/367] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:22 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:22.509152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:22.509697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:22.519174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.523466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:22.523466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.523466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:22.752537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:22.761257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3ff91087-8ad9-4a0a-89c1-ae5ef48d728e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.261531 Nov 13 07:50:22.773125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 178/368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:22 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:22.871413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:22.872035 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:22.879725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.880366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:22.885373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:22.885373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:23.122019 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:23.137651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:23.145279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:23.146428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-30c46256-16ab-4f68-8757-2817ea0adfe3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.286007 Nov 13 07:50:23.146985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 191/369] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:22 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:23.172493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:23.172493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:23.177116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:23.177635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:23.178783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:23.179313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:23.254715 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e396008-6245-4a94-b9e3-1f02a0c72928 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096106 Nov 13 07:50:23.255273 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 179/370] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:23 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:23.785745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:23.786351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:23.793806 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:23.794268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:23.795104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:23.795600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:24.050762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:24.058991 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6a62b60f-3453-4cf9-bb43-adc5bb3439c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.282439 Nov 13 07:50:24.059509 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 192/371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:23 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:24.169941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:24.170539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:24.178280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:24.178748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:24.179514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:24.179941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:24.271801 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:24.272829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:24.280066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:24.280595 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:24.284052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:24.284052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:24.358377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9cbbe30a-7f4e-48b6-817b-d30c853ea553 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096505 Nov 13 07:50:24.359217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 193/372] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:24 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:50:24.388623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:24.402509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:24.409604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:24.410716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2490aea6-8aee-48b4-b7c2-39c03a8a6028 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.249932 Nov 13 07:50:24.411267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 180/373] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:24 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:25.082781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:25.083394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:25.090643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.091164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.091949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.092385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.319488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:25.328793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-32d9d310-96f4-4b81-9083-100e66bd6653 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.255989 Nov 13 07:50:25.329482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 194/374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:25 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:25.375288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:25.376728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:25.384532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.384780 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.385813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.386271 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.442871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:25.443755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:25.452994 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.453720 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.454730 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.455236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.470110 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae8856c4-f2b7-4317-af2d-8683129ab557 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104580 Nov 13 07:50:25.471227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 181/375] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:25 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:25.696927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:25.710279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:25.716507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:25.717617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-def7b394-f57a-4b3a-8f2f-a021326d7605 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1744 microversion: 2.20 time: 0.291238 Nov 13 07:50:25.718126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 195/376] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:25 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:25.747183 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:25.748110 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:25.755297 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.755743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.756508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:25.756943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:25.817157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lazy-loading 'flavor' on Instance uuid 8908876f-0fbb-43e5-861d-16599dc0dbf8 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:50:26.288742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4253b5e0-a7a0-4abb-94d8-deb82dd65328 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action" status: 200 len: 32 microversion: 2.1 time: 0.550615 Nov 13 07:50:26.289330 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 182/377] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:50:25 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:50:26.304865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:26.305561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:26.313370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.313823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.315159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.315598 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.356174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:26.356859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:26.364629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.365078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.365852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.366282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.611084 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:26.634794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-12e060ed-72a6-46dc-9849-9a6656293e72 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.288251 Nov 13 07:50:26.635352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 183/378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:26 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:26.657421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:26.658709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:26.671272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.672207 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.673138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.674389 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.689093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:26.703011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-92af5fd0-0273-4615-b4ce-d128f8811dc0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.408375 Nov 13 07:50:26.703557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 196/379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:26 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:26.743188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:26.743792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:26.760194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.760640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.765632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:26.768447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:26.803321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-05e9e6f8-6283-4499-baad-0f995e654b81 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155082 Nov 13 07:50:26.803321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 184/380] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:26 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:27.199315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:27.216484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:27.227103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:27.228427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a2ffc007-c754-406d-99ca-c6f5af716279 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1744 microversion: 2.20 time: 0.496483 Nov 13 07:50:27.232831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 197/381] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:26 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1744 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:27.663565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:27.664249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:27.671358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.671805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.672569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.672998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.729119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:27.729737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:27.737936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.738379 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.739186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.739616 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.890372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:27.899977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ed9cef1c-d87a-4c91-9d97-0ca9406da363 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.245824 Nov 13 07:50:27.900729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 185/382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:27 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:27.910973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:27.911924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:27.919266 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.919719 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.920498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:27.920928 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:27.959041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:27.967916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0786e6bc-a9d5-4ed1-a8fd-59e9b8d98381 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.251403 Nov 13 07:50:27.968439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 198/383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:27 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:27.996835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-41f53eca-f2a0-4d27-8ed8-15d2e08951f1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094922 Nov 13 07:50:27.997586 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 186/384] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:50:27 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:50:28.215258 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1054963724", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "13dc6fb3-9bcb-4e4a-8416-084631603788"}]}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:28.255967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:28.256788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:28.264637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.265088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.265874 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.266346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.292860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] validate_networks() for [('13dc6fb3-9bcb-4e4a-8416-084631603788', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:50:28.494140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:28.508795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:28.516004 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:28.517151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6942f162-e867-46d3-8553-78153058c907 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.272446 Nov 13 07:50:28.517975 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 187/385] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:28 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:28.881933 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-2bc70ca2-589c-4a8f-a217-b778d77df540 req-19942a6d-0fc1-4be6-9593-0e857b5ce25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "name": "network-vif-plugged", "status": "completed", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:28.888259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:28.888259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:50:28.897143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-2bc70ca2-589c-4a8f-a217-b778d77df540 req-19942a6d-0fc1-4be6-9593-0e857b5ce25f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.897588 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-2bc70ca2-589c-4a8f-a217-b778d77df540 req-19942a6d-0fc1-4be6-9593-0e857b5ce25f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.914648 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-2bc70ca2-589c-4a8f-a217-b778d77df540 req-19942a6d-0fc1-4be6-9593-0e857b5ce25f service nova] Creating event network-vif-plugged:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:50:28.920321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-2bc70ca2-589c-4a8f-a217-b778d77df540 req-19942a6d-0fc1-4be6-9593-0e857b5ce25f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050330 Nov 13 07:50:28.921006 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 188/386] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:50:28.933068 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:28.933773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:28.937136 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:50:28.937561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:50:28.938030 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:50:28.938437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:50:28.938892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:50:28.946291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.947012 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.947847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.948130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.948517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.948630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.949369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:28.949801 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:28.968331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:50:28.973128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for user e0728501bcf8493a8704d5ca9f4dadf0 and project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:50:28.985004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:50:28.987666 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:50:29.114111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6cf2a820-aca4-4dcb-a31c-82ad4e43a5da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907657 Nov 13 07:50:29.114657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 199/387] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:50:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:50:29.141849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:29.143067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:29.151023 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:29.151485 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:29.152304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:29.152759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:29.226536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.239569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cee5a782-f2b6-4a11-8fd8-9adf85a8de6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.317225 Nov 13 07:50:29.250536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 189/388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:28 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:29.258623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d477059-75c8-410d-93ef-c97aaf25998e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:29.259383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d477059-75c8-410d-93ef-c97aaf25998e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:29.394177 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2d477059-75c8-410d-93ef-c97aaf25998e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.404168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2d477059-75c8-410d-93ef-c97aaf25998e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1218 microversion: 2.1 time: 0.162599 Nov 13 07:50:29.405175 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 190/389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:29 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:29.443012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.467706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2e874eb6-cf66-42bb-9584-a1e93c1fc16d tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.346546 Nov 13 07:50:29.468202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 200/390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:29 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:29.545778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:29.546522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:29.579476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:29.586791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:29.589244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:29.589891 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:29.909934 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.929529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.937467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:29.938987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e72d2079-d75a-4f27-8a6f-a018e7c0d388 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.406508 Nov 13 07:50:29.941423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 191/391] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:29 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:30.262792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:30.263499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:30.274369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.274932 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.275770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.276207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.436884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:30.437923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:30.446098 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.447048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.448061 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.448593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.529407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:30.542005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5edf5827-6280-4a0a-b163-fd24cb1d8731 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.288476 Nov 13 07:50:30.573851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 201/392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:30 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:30.597397 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:30.627762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:30.653997 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.653997 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.653997 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.656909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.684531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:30.725485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e4db5ab7-770c-4379-8f37-f916a70fe35d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1222 microversion: 2.1 time: 0.303891 Nov 13 07:50:30.735320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 192/393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:30 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:30.950914 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:30.963747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-41ebfd64-09b5-45f4-b534-a8738a38c781 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.385478 Nov 13 07:50:30.963922 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:30.964633 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 202/394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:30 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:30.971571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:30.985916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.987374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:30.988274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:30.988872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:31.315027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:31.337458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:31.344528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:31.346473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-68c53031-4534-446f-871b-1f07559ff9d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.392895 Nov 13 07:50:31.347202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 193/395] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:30 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:31.618981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:31.621613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:31.643684 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:31.644562 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:31.645645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:31.646479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:31.748880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:31.749414 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:31.759751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:31.760292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:31.761169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:31.761452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:31.923827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:31.936640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:31.952470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ac0928bd-8c23-4720-8694-b05f253ac0e4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1270 microversion: 2.1 time: 0.209359 Nov 13 07:50:31.953217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ec9573c9-5e40-4f81-ad92-c5cc3e27811a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.348827 Nov 13 07:50:31.954299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 203/396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:31 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:31.961479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 194/397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:31 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:31.997546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:31.998547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:32.017859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:32.018318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:32.019785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:32.020388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:32.328940 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:32.340497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8836e65c-9913-43e9-ad75-f4f0f5deb8dd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.363023 Nov 13 07:50:32.352363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 204/398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:31 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:32.378093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:32.380314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:32.405723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:32.411883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:32.413546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:32.414331 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:32.702623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:32.718134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:32.725112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:32.726485 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a9ab6f45-8765-450e-a715-938d60f63673 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.359107 Nov 13 07:50:32.738487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 195/399] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:32 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:33.004957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:33.008437 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:33.015207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:33.016274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:33.037823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.039587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.040540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.044580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.086548 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.087570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.088622 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.089655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.393887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:33.406023 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-223c829f-7c9d-4325-afc0-3da9bee45a56 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1278 microversion: 2.1 time: 0.441261 Nov 13 07:50:33.409185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 205/400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:32 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1278 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:33.435752 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:33.436932 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:33.452175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.453614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.454590 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.455953 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.485523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:33.502188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6003c977-35f6-4d85-ac45-d40b0b233823 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.533958 Nov 13 07:50:33.511996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 196/401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:32 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:33.781499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:33.781499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:33.781499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.781499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.784003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:33.784003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:33.837148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:33.848476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dd2b3a69-be90-4b55-8c2a-e27db0466ef1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.437954 Nov 13 07:50:33.849620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 206/402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:33 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:34.115572 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:34.135262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:34.147499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:34.148868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e76b97c-5dec-496a-a9f7-a32ed487709f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.402120 Nov 13 07:50:34.149917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 197/403] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:33 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:34.437191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:34.439465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:34.484235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.487017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:34.488049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.489103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:34.527795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:34.530885 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:34.542713 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.543766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:34.544726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.545723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:34.720818 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:34.741760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fa413edf-c9f8-4382-92fd-8b83b33c6ebb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1276 microversion: 2.1 time: 0.318645 Nov 13 07:50:34.751620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 207/404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:34 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:34.827387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:34.839106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-102cf428-deee-4267-aba8-74152a042721 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.322995 Nov 13 07:50:34.848683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 198/405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:34 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:34.876613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:34.877929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:34.887935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.889179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:34.889938 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:34.890475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.187589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:35.190368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:35.208529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.222041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.222041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.222041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.249793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:35.261471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-96c5bb9a-3c4d-446f-841d-d7986007e2fc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.399196 Nov 13 07:50:35.262332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 208/406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:34 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:35.535554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:35.553443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:35.560860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:35.562414 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7d8e7048-1d5d-49d6-ba27-da9c67196717 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.397277 Nov 13 07:50:35.566741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 199/407] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:35 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:35.763788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:35.764490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:35.784786 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.785310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.786310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.786539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.869608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:35.869877 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:35.907199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.907651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:35.908987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:35.909428 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.229985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:36.246123 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-45cd2954-c875-4eda-a1fc-3f87fd583f4b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.392453 Nov 13 07:50:36.247730 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 200/408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:35 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:36.286575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:36.287380 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:36.296587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.296962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.297894 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.299679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.557814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:36.577591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4417c9d0-cc82-4e2e-9fb7-fa1717b01a99 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.822696 Nov 13 07:50:36.578820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 209/409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:35 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:36.600258 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:36.601307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:36.611917 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.612685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.613941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.614559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.638513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:36.651525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7cf06c41-8699-4cfe-9cb3-2f58c1c10378 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.377200 Nov 13 07:50:36.661550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 201/410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:36 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:36.791559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87f09820-1834-4d37-afbc-f35fcf7503ec", "device": "/dev/sdb"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:36.807131 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:36.823314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.826102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:36.826102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:36.826578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:37.078363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:37.106512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:37.122268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:37.125566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f8195e71-0e4f-421f-99df-07975741d065 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.545496 Nov 13 07:50:37.130204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 210/411] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:36 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:37.281409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:37.281938 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:37.291736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:37.292408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:37.293365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:37.299525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:37.630188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:37.643269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7030dc5a-716e-4540-8f4b-385640b536da tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.377982 Nov 13 07:50:37.646316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 211/412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:37 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:37.657428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-52c56ca0-8170-4167-9ae8-300e8caa7047 req-226c9b32-a3f1-473d-bbc5-f4ac9d450ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae6ec323-dff8-4169-9a56-94903662c347", "tag": "acac643d-73db-44ba-af16-2880e5385d21"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:37.664121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:37.664121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:50:37.674940 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-52c56ca0-8170-4167-9ae8-300e8caa7047 req-226c9b32-a3f1-473d-bbc5-f4ac9d450ea9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:37.682692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-52c56ca0-8170-4167-9ae8-300e8caa7047 req-226c9b32-a3f1-473d-bbc5-f4ac9d450ea9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:37.712178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-52c56ca0-8170-4167-9ae8-300e8caa7047 req-226c9b32-a3f1-473d-bbc5-f4ac9d450ea9 service nova] Creating event network-changed:acac643d-73db-44ba-af16-2880e5385d21 for instance ae6ec323-dff8-4169-9a56-94903662c347 on hv-cinder-81783 Nov 13 07:50:37.717388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-52c56ca0-8170-4167-9ae8-300e8caa7047 req-226c9b32-a3f1-473d-bbc5-f4ac9d450ea9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069771 Nov 13 07:50:37.718207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 212/413] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:37.729708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:37.730483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:37.741303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:37.741788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:37.743502 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:37.747029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.119133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e569bc70-8196-4686-983e-8b3841cec328 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "POST /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.344636 Nov 13 07:50:38.120548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 202/414] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:50:36 2021] POST /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589/os-volume_attachments => generated 194 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:50:38.150841 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:38.151618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:38.161571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.162105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.163040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.163515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.374573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:38.386816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-15b21506-3b0b-4ac5-bd8c-38dc594ed391 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.666945 Nov 13 07:50:38.402107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 213/415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:37 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:38.417873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:38.418713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:38.442096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.442978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.444144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.453625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.674633 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:38.693166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae6de8a0-d350-41d4-a399-44cfe20acf18 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.570639 Nov 13 07:50:38.700828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 203/416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:38 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:38.719472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:38.719472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:38.725919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.726369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.727243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:38.727678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:38.908239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:38.927517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:38.935505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:38.937047 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4103ff37-5fd7-4437-92bf-fb1a8ef176c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.533393 Nov 13 07:50:38.938090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 214/417] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:38 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:38.990866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:39.000507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b996552d-a0a2-4ff9-8e5e-af6558eb546e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.297456 Nov 13 07:50:39.001379 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 204/418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:38 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:39.419088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:39.420027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:39.447094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.471269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:39.471269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.471269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:39.723314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:39.723967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:39.743313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.743758 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:39.744574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.745007 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:39.860109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:39.868550 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-aa50eb0a-db41-41c1-9c25-d9e1d283796b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.462919 Nov 13 07:50:39.878341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 215/419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:39 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:39.953912 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:39.963154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ea8737c2-715f-41f7-8125-f26fe7f7c4d3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.249577 Nov 13 07:50:39.966344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 205/420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:39 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:39.966465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:39.966465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:39.971850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.972431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:39.973277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:39.973714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:40.033471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:40.034087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:40.055867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:40.056654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:40.057628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:40.058218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:40.273883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:40.305418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:40.316064 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:40.317908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-711467c4-8790-492f-8fe8-147212793d6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.364178 Nov 13 07:50:40.321463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:40.331112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 216/421] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:39 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:40.343470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d27696a2-7ac8-42d9-9a1b-4ac2b00af1bb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.326456 Nov 13 07:50:40.344570 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 206/422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:40 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:40.898971 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:40.899677 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:40.906893 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:40.907345 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:40.909650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:40.909650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:40.987828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:40.989258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:41.001612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.003029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.004009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.004545 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.199464 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.210041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-80ef20cf-b02b-472b-bddb-dd9d58c999fa tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.328488 Nov 13 07:50:41.220927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 217/423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:40 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:41.241927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.253140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bc65f7b4-f133-4a67-9b30-3b0c8f83561c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.276037 Nov 13 07:50:41.256749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 207/424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:40 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:41.349884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:41.350848 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:41.358477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.359293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.360155 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.360743 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.369506 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:41.370530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:41.380147 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.380996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.382258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:41.383009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:41.744490 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.765473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-71aabb77-a9f9-4d81-811c-e1a08dba8f2b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.407499 Nov 13 07:50:41.777674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 208/425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:41 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:41.884273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.906811 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.924593 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:41.929795 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4659c112-9a7c-4430-a330-d2df070a074f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.595026 Nov 13 07:50:41.930708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 218/426] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:41 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:42.234270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:42.235525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:42.244692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.245774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.246763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.247460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.278134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:42.283894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:42.293881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.294605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.295846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.297056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.555501 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:42.578916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e7c41b86-fc26-4a55-88c2-bb8576b37ab4 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.355370 Nov 13 07:50:42.580252 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 209/427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:42 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:42.596360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:42.609680 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9bdd8e6f-6cec-433c-bf9f-ccd125daffb9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.342690 Nov 13 07:50:42.610154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 219/428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:42 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:42.795247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:42.795934 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:42.804512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.804993 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.805815 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.806258 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.957138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:42.957759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:42.980056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:42.992539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:42.992539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:43.000484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:43.222353 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:43.233249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8c136bed-ed7e-47e7-b650-672f851a60f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1725 microversion: 2.1 time: 0.452889 Nov 13 07:50:43.250866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 210/429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:42 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1725 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:43.380796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:43.400387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:43.406977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:43.408715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a04d447-5b16-48fd-ad78-881f74315099 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.463043 Nov 13 07:50:43.409586 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 220/430] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:42 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:43.608609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:43.610211 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:43.622505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:43.623246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:43.624737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:43.625744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:43.636160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:43.637075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:43.653325 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:43.653999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:43.655093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:43.655607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:43.965279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:43.975498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2218b699-04cf-4999-8775-ce8d1e988cfd tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.381185 Nov 13 07:50:43.976397 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 211/431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:43 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:44.014418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:44.024975 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ec350ee9-1240-4681-a81a-0c68e09c0d38 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.398989 Nov 13 07:50:44.025728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 221/432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:43 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:44.267612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:44.268355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:44.282983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:44.283499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:44.284294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:44.284728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:44.438014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:44.438540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:44.446259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:44.446747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:44.447538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:44.447968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:44.552706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:44.565905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-24403c19-8344-4cd6-b283-5a590c26823d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1702 microversion: 2.1 time: 0.312238 Nov 13 07:50:44.567162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 212/433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:44 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1702 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:44.589262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a2b4aefe-c994-40f6-824a-6e5f39a334ce tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:44.601791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a2b4aefe-c994-40f6-824a-6e5f39a334ce tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:44.601791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a2b4aefe-c994-40f6-824a-6e5f39a334ce tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:44.667479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a2b4aefe-c994-40f6-824a-6e5f39a334ce tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Going to try to start instance {{(pid=97389) start /opt/stack/nova/nova/compute/api.py:2622}} Nov 13 07:50:44.691636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:44.705479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:44.711834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:44.712927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7b4951ba-9f24-4b6e-9cfc-b9b603d48949 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.286936 Nov 13 07:50:44.713457 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 222/434] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:44 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:45.009715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:45.010701 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:45.022663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a2b4aefe-c994-40f6-824a-6e5f39a334ce tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 202 len: 0 microversion: 2.1 time: 0.442913 Nov 13 07:50:45.023268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.028812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 213/435] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:50:44 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:50:45.030211 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.048657 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:45.049698 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.050548 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.051002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:45.063174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.064231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.065836 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.066449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.458705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:45.467385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0b4e3d7e-9267-4752-b11a-652228f7374c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1711 microversion: 2.1 time: 0.434782 Nov 13 07:50:45.475943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 214/436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:45 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1711 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:45.490156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:45.490795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:45.510833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.512112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.512926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.513360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.570884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:45.602231 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1b51b6d7-a080-428d-a8a6-6206b6ed3037 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.606015 Nov 13 07:50:45.604676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 223/437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:44 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:45.752741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:45.754056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:45.770039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.770488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.771677 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:45.772336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:45.869923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:45.879493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8e8fc368-9fbd-4afb-b4c4-ff24fd0acf56 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.402222 Nov 13 07:50:45.889515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 215/438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:45 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:46.175284 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:46.195388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:46.204064 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:46.206183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a3cf4f1c-9361-40f4-9fa9-aa5ed865d147 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.477595 Nov 13 07:50:46.206773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 224/439] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:45 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:46.508311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:46.508311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:46.513781 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.514246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:46.515269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.515464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:46.627435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:46.628202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:46.635527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.635981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:46.636771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.637210 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:46.844540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:46.874969 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e95b7f58-10af-4e02-aecc-1c117bc39e5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1711 microversion: 2.1 time: 0.391120 Nov 13 07:50:46.875706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 216/440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:46 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1711 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:46.905620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:46.905856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:46.906276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:46.910706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bf018af4-af8f-41d6-95bf-139cf0fbe3d5 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.293130 Nov 13 07:50:46.911736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 225/441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:46 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:46.932779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.933232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:46.934020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:46.934457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.077178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-3e6df532-6eca-4553-b081-ae02c1d2f72e req-ed6a87a3-6894-41e9-a8ce-7fbc0292dab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6ec323-dff8-4169-9a56-94903662c347", "name": "network-vif-plugged", "status": "completed", "tag": "acac643d-73db-44ba-af16-2880e5385d21"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:47.085468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:47.085468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:50:47.096373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-3e6df532-6eca-4553-b081-ae02c1d2f72e req-ed6a87a3-6894-41e9-a8ce-7fbc0292dab2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.096850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-3e6df532-6eca-4553-b081-ae02c1d2f72e req-ed6a87a3-6894-41e9-a8ce-7fbc0292dab2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.120011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-3e6df532-6eca-4553-b081-ae02c1d2f72e req-ed6a87a3-6894-41e9-a8ce-7fbc0292dab2 service nova] Creating event network-vif-plugged:acac643d-73db-44ba-af16-2880e5385d21 for instance ae6ec323-dff8-4169-9a56-94903662c347 on hv-cinder-81783 Nov 13 07:50:47.126000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-3e6df532-6eca-4553-b081-ae02c1d2f72e req-ed6a87a3-6894-41e9-a8ce-7fbc0292dab2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059658 Nov 13 07:50:47.128626 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 226/442] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:50:47.184954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:47.194995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ba88eae7-82c9-45c7-bbe5-045b33a54f8f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.302403 Nov 13 07:50:47.202004 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 217/443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:46 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:50:47.240046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:47.240873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:47.249923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.249923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.251573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.252016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.602224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:47.618851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:47.625476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:47.627227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c3ae7fa0-a2b5-4990-972f-e23df0b4a1a7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1739 microversion: 2.20 time: 0.398953 Nov 13 07:50:47.634867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 227/444] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:47 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:47.911288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:47.913083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:47.921541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.922333 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.923923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.924677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.933170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:47.939903 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:47.951340 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.951790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:47.952576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:47.953009 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:48.163238 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:48.173780 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-01259a60-8210-44d3-a1a5-4c06cd7fd45b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1715 microversion: 2.1 time: 0.283820 Nov 13 07:50:48.175570 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 218/445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:47 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1715 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:48.197355 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:48.207429 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-42b8df0f-87e8-450e-9837-cdd3dca81b12 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.282880 Nov 13 07:50:48.208784 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 228/446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:47 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:48.217707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:48.221032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:48.226374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:48.227009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:48.227797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:48.228232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:48.455626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:48.465267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c3bde55d-dbc0-46ee-9e58-2510ace7bae8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.256585 Nov 13 07:50:48.466705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 219/447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:48 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:48.655846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:48.656551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:48.664830 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:48.665781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:48.667392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:48.668057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:49.045710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:49.059527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:49.066332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:49.067453 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e49fbca3-cec8-497d-b738-18dbde486796 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.424181 Nov 13 07:50:49.067977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 229/448] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:48 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:49.231259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:49.231892 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:49.240290 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:49.240750 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:49.241536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:49.241977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:49.451073 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:49.459231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9fa10215-eee7-401e-8845-57eda0daac8e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.237875 Nov 13 07:50:49.459760 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 220/449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:49 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:49.489239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:49.489852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:49.500140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:49.500946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:49.502351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:49.503150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:49.714022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:49.723430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-18008c10-adf7-479e-927f-b59cbe951e58 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.244084 Nov 13 07:50:49.724032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 230/450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:49 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:50.091416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:50.092017 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:50.099796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.100241 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.101008 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.101439 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.307265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:50.321003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:50.327257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:50.328340 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6e20798f-c439-4081-b4fe-99191acc4f93 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.246156 Nov 13 07:50:50.328855 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 221/451] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:50 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:50.480992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:50.481599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:50.489663 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.490113 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.490909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.491344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.695356 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:50.703227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5fa23200-9998-405a-8837-81b5d4e6542f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.231329 Nov 13 07:50:50.703748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 231/452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:50 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:50.748339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:50.748936 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:50.756852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.757232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.757998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:50.758424 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:50.957578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:50.965968 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-221895b9-7390-474c-9337-70f204ae77e8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.226683 Nov 13 07:50:50.966491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 222/453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:50 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:51.353146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:51.353746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:51.361087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.361565 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:51.362362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.362833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:51.560739 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:51.574954 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:51.581881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:51.583065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-66d93008-d9d6-43f7-a2ac-67967d8b4690 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.239848 Nov 13 07:50:51.583585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 232/454] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:51 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:50:51.725125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:51.725738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:51.733216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.733918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:51.734732 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.735176 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:51.943445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:51.951483 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-27ff0fa6-2529-41ca-85fd-9718cce07d5b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.235536 Nov 13 07:50:51.951924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 223/455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:51 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:51.989181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:51.989785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:51.996908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.997358 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:51.998133 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:51.998562 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:52.204883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:52.213243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d686a41c-7c0d-42c2-a75c-8881d41907cf tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.233882 Nov 13 07:50:52.213759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 233/456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:51 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:52.607336 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:52.607940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:52.616566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:52.616953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:52.617721 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:52.618153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:52.834199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:52.848388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:52.854642 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:52.855751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-89ccd7a1-b67c-46ba-9323-c7cff6116ceb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.257828 Nov 13 07:50:52.856274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 224/457] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:52 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:52.910447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-4e674eea-6083-43fc-b74e-f3959c30dc9d req-8797810b-a897-4d2b-b621-361b7c9516cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "name": "network-vif-unplugged", "status": "completed", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:52.916915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:50:52.916915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:50:52.925241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-4e674eea-6083-43fc-b74e-f3959c30dc9d req-8797810b-a897-4d2b-b621-361b7c9516cc service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:52.925684 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-4e674eea-6083-43fc-b74e-f3959c30dc9d req-8797810b-a897-4d2b-b621-361b7c9516cc service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:52.942236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-4e674eea-6083-43fc-b74e-f3959c30dc9d req-8797810b-a897-4d2b-b621-361b7c9516cc service nova] Creating event network-vif-unplugged:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:50:52.946916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-4e674eea-6083-43fc-b74e-f3959c30dc9d req-8797810b-a897-4d2b-b621-361b7c9516cc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046079 Nov 13 07:50:52.947493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 234/458] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:50:52.974620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:52.975790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:52.983460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:52.984184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:52.985009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:52.985443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:53.197476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:53.206414 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b28a7dfe-b919-4520-a839-3bf69e265f08 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1318 microversion: 2.1 time: 0.241741 Nov 13 07:50:53.206984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 225/459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:52 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:53.235707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:53.236424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:53.244054 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:53.251394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:53.251394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:53.251394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:53.600526 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:53.609676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cec96204-b90b-4393-badc-6b81dbbeee65 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.384214 Nov 13 07:50:53.610201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 235/460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:53 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:53.879532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:53.880126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:53.887261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:53.887702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:53.888472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:53.888906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:54.115816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:54.129203 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:54.135957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:54.137089 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ba97e214-a9ba-4fdd-8b27-3c03757455d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.266719 Nov 13 07:50:54.137497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 226/461] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:53 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:54.230433 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:54.231066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:54.239037 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:54.239483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:54.240245 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:54.240678 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:54.441482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:54.449442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-409a8955-a9f7-4be4-8426-553f708fad5f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1508 microversion: 2.1 time: 0.229567 Nov 13 07:50:54.450542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 236/462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:54 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:54.633489 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:54.634088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:54.643487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:54.643487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:54.643705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:54.644046 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:54.847101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:54.855691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a9c3288b-2513-4571-a388-ededa021eafc tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.232214 Nov 13 07:50:54.856224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 227/463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:54 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:55.160984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:55.168610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:55.169223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:55.169843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:55.170816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:55.171245 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:55.389184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:55.402476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:55.409219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:55.410281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e849495a-b9e8-463c-aa05-a856bcab771b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.258603 Nov 13 07:50:55.410821 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 237/464] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:55 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:55.877301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:55.877824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:55.884958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:55.885405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:55.886177 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:55.886612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:56.088773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:56.097194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-31df433f-ab74-4a55-bfe0-99d8df65df40 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.229162 Nov 13 07:50:56.097718 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 228/465] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:55 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:56.433596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:56.434144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:56.441798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:56.442244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:56.443039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:56.443471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:56.643316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:56.656455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:56.662656 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:56.663764 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7446b90d-97ef-4073-9d38-48442559ecf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.239213 Nov 13 07:50:56.664277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 238/466] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:56 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:57.120101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:57.120694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:57.128133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:57.128579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:57.129345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:57.129822 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:57.328830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:57.337900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-25ac2fa0-4170-439d-9bc8-f6f98fae1274 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.227593 Nov 13 07:50:57.338433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 229/467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:57 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:57.687722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:57.688319 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:57.695971 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:57.696415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:57.697179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:57.697608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:57.970151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:57.983338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:57.990774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:57.991866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d88bdee9-b1b3-4897-89eb-19ea50f12322 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1721 microversion: 2.20 time: 0.313287 Nov 13 07:50:57.992359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 239/468] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:57 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:58.361343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:58.362482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:58.370154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:58.370703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:58.371486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:58.372452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:58.738650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:58.747478 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-434e93cb-d532-42a4-9cea-9540dd7ff927 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.395623 Nov 13 07:50:58.748465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 230/469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:50:58 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:50:59.016092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:50:59.016712 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:59.024820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.025281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:59.026070 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.026508 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:59.247049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:59.261060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:59.267713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:50:59.286850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-255a8f16-90ec-4220-8b94-f4847c0c3a20 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1724 microversion: 2.20 time: 0.262573 Nov 13 07:50:59.286850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 240/470] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:50:59 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:50:59.293380 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39935685-1f9b-4d9e-abe5-890ed1e2ff09"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:59.294776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:59.302576 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.303073 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:59.303854 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.304286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:59.564929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f5e0294-ebeb-4604-b988-dbd3c6d82273"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:50:59.566614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:50:59.574202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.574762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:50:59.575653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:50:59.576150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:00.895093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8153045d-b599-4d2c-97c9-fa825b4ffa06 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.611724 Nov 13 07:51:00.900663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 231/471] 10.222.0.32 () {62 vars in 1363 bytes} [Sat Nov 13 07:50:59 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 188 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:51:00.906650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:00.911007 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:00.915175 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:00.915948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:00.916712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:00.917151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:01.140948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:01.150014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f3a242a0-669c-4a05-8b2f-558782b4d6f2 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.252884 Nov 13 07:51:01.158537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 232/472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:00 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:01.310198 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:01.310783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:01.318492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:01.318981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:01.319747 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:01.320174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:01.382157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8cc72ba6-f337-40f1-9f54-0642efb0d447 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.828424 Nov 13 07:51:01.382712 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 241/473] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:50:59 2021] POST /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 194 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:01.730751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ce98e5fe-bf88-4be2-9741-3abe3f70b4ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action" status: 202 len: 0 microversion: 2.20 time: 0.429587 Nov 13 07:51:01.731614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 233/474] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:51:01 2021] POST /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 13 07:51:01.752063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:01.752771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:01.760814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:01.761259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:01.762043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:01.762470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:01.969851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:01.984590 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:01.990924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:01.992011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c01f1831-9de4-4980-bab5-99edc48dc00c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1750 microversion: 2.20 time: 0.255649 Nov 13 07:51:01.992528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 242/475] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:01 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:02.174179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:02.174883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:02.181976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:02.182423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:02.183240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:02.183671 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:02.407905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:02.416450 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c3e33981-5f94-407a-850b-a205b3e9c11b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.251330 Nov 13 07:51:02.416967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 234/476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:02 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:03.015767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:03.016377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:03.023425 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:03.023884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:03.024655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:03.025145 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:03.252167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:03.268075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:03.275716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:03.276852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4db4b786-4153-4289-b3ed-f2d5d2ba6b4f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1750 microversion: 2.20 time: 0.270265 Nov 13 07:51:03.289580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 243/477] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:03 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1750 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:03.444604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:03.461637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:03.476127 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:03.476753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:03.477694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:03.478303 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:03.741021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:03.746521 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-578312de-232a-46c6-b915-e5d4084133e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.316960 Nov 13 07:51:03.747153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 235/478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:03 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:04.303610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:04.304339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:04.312455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:04.312989 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:04.313822 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:04.314250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:04.517306 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:04.531465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:04.538585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:04.539800 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-37f73880-abd4-4341-a03a-e9a574c7f255 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.247011 Nov 13 07:51:04.540317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 244/479] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:04 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:04.772099 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:04.772803 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:04.780195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:04.780645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:04.781498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:04.781940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:05.061785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:05.071477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3d643b21-a67b-4a6e-8c2b-285f8d56b15b tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.310134 Nov 13 07:51:05.071818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 236/480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:04 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:05.564529 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:05.565734 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:05.573154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:05.573597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:05.574410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:05.574862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:05.788726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:05.803443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:05.810178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:05.811314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e3e23688-6d5b-4c2c-94e8-f52bab23b01f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.256056 Nov 13 07:51:05.811814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 245/481] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:05 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:06.093020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:06.093629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:06.101280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:06.101732 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:06.102510 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:06.102970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:06.375733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:06.382249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9b220cf0-faab-48b5-bbff-3894c19f5cf1 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.298418 Nov 13 07:51:06.383153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 237/482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:06 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:06.837341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:06.837890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:06.846397 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:06.846881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:06.847661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:06.848089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:07.056277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:07.070388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:07.076599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:07.077694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2106a130-4126-484f-bfea-6d3b015a0306 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.251134 Nov 13 07:51:07.078190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 246/483] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:06 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:07.403654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:07.404253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:07.411843 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:07.412291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:07.413061 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:07.413492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:07.647937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:07.657536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0e18f3c1-18c6-4ed1-8db0-56af899346e3 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.263069 Nov 13 07:51:07.658068 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 238/484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:07 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:08.101498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:08.102384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:08.110309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:08.110970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:08.111805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:08.112294 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:08.320918 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:08.335516 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:08.341712 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:08.348329 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-86b7d961-0194-43a9-a3ee-6211f7de309b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.250839 Nov 13 07:51:08.348329 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 247/485] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:08 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:08.681268 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:08.681875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:08.689432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:08.690563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:08.691310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:08.691746 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:09.023954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:09.033775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fde49056-6af0-4b1f-916e-ef94ca17c741 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1567 microversion: 2.1 time: 0.362195 Nov 13 07:51:09.034456 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 239/486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:08 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:09.367672 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:09.368276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:09.375384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:09.375959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:09.376603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:09.377045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:09.687886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:09.712826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:09.720467 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:09.722140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a4c98bd-9f59-4f38-8412-369ddff50f98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.364715 Nov 13 07:51:09.722657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 248/487] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:09 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:10.056385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:10.057102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:10.064298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.064794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.065580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.066090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.295667 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:10.304197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-50c205ce-e572-46dc-a762-a903a6299565 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1547 microversion: 2.1 time: 0.257316 Nov 13 07:51:10.304727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 240/488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:10 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:10.326950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:10.327523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:10.336473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.336925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.337714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.338170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.605803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] HTTP exception thrown: Cannot 'detach_volume' instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 while it is in vm_state rescued Nov 13 07:51:10.607274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Returning 409 to user: Cannot 'detach_volume' instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 while it is in vm_state rescued {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:51:10.609449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5724c168-b9d6-40be-9313-a74bc57f98d8 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments/f6561935-2e76-4d39-8143-6c1c03160d2a" status: 409 len: 152 microversion: 2.1 time: 0.292130 Nov 13 07:51:10.610347 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 249/489] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:51:10 2021] DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments/f6561935-2e76-4d39-8143-6c1c03160d2a => generated 152 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 13 07:51:10.631120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:10.631675 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:10.651974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.655465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.656296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.656733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.759066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:10.760087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:10.768310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.769029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:10.770080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:10.770771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:11.011654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:11.026220 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:11.032619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:11.033792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9485c08e-9a3f-46e7-a99b-7283481bf2ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.285600 Nov 13 07:51:11.034607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 250/490] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:10 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:11.061404 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-adbb5c3f-5c58-4973-9819-18ffd5d89995 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action" status: 202 len: 0 microversion: 2.1 time: 0.444714 Nov 13 07:51:11.061404 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 241/491] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:51:10 2021] POST /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:51:11.081890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:11.082501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:11.090085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:11.090536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:11.091362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:11.091799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:11.379066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:11.401377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bc048514-60dd-4130-8b14-d829bd7cb7ee tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1555 microversion: 2.1 time: 0.321429 Nov 13 07:51:11.401377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 251/492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:11 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:12.059706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:12.060969 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:12.070529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.073793 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.075033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.075729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.201276 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:12.201890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:12.210735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.211393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.212356 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.213339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.434326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:12.464557 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:12.472030 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:12.473360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-68a9260e-8293-4210-8681-60483744bfa5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.423682 Nov 13 07:51:12.474424 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 242/493] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:12 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:12.485078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:12.485922 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:12.494491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.495356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.496305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:12.496891 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:12.731574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:12.741196 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dd5f5c08-6288-4489-a884-3754051ba2ce tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1555 microversion: 2.1 time: 0.265543 Nov 13 07:51:12.751045 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 243/494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:12 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:12.786805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-08e3ed7b-281e-4966-a34f-b72672533117 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589/os-volume_attachments/87f09820-1834-4d37-afbc-f35fcf7503ec" status: 202 len: 0 microversion: 2.1 time: 0.603763 Nov 13 07:51:12.787538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 252/495] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:51:12 2021] DELETE /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589/os-volume_attachments/87f09820-1834-4d37-afbc-f35fcf7503ec => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:51:13.497689 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:13.498931 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:13.508253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:13.508895 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:13.509734 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:13.510363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:13.751214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:13.766043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:13.771981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:13.772122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:13.775080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:13.775439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:13.775890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:13.776673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:13.777103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:13.777296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-442ed796-4f18-4407-b2e0-169d902428ad tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.289089 Nov 13 07:51:13.789082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 244/496] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:13 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:14.059965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:14.079736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-190088a9-04ac-448c-aae9-94e3f1d3a377 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1555 microversion: 2.1 time: 0.314245 Nov 13 07:51:14.079736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 253/497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:13 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1555 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:14.807923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:14.807923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:14.812031 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:14.812479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:14.813267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:14.813692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:15.094624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:15.095270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:15.107759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:15.108710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:15.110311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:15.111200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:15.201003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:15.231650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:15.247825 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:15.249014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dd06894d-e46f-420a-84d7-e1316f7625bc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.457091 Nov 13 07:51:15.254999 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 245/498] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:14 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:15.753240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:15.769709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-34c33441-323a-4a8d-8c27-f1a8c30323b6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1561 microversion: 2.1 time: 0.685410 Nov 13 07:51:15.770709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 254/499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:15 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1561 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:15.902275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:15.902809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:15.910785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:15.911238 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:15.912022 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:15.912457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:16.274550 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:16.275194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:16.282852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:16.283892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:16.284666 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:16.285102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:16.488335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cd6ca41a-ca24-49cd-acb3-c96c3d10d380 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments/f6561935-2e76-4d39-8143-6c1c03160d2a" status: 202 len: 0 microversion: 2.1 time: 0.595232 Nov 13 07:51:16.489166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 246/500] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:51:15 2021] DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments/f6561935-2e76-4d39-8143-6c1c03160d2a => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:51:16.504749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:16.506074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:16.513634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:16.514308 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:16.515607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:16.516243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:16.530330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:16.542849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:16.550387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:16.551739 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1903b048-96c0-4ff5-89a5-8e00b49bdeee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.287181 Nov 13 07:51:16.552771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 255/501] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:16 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:16.595527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e1302026-bcc3-484b-9fd1-053e7e640011 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101843 Nov 13 07:51:16.596162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 247/502] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:16 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:51:17.575373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:17.581605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:17.598190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:17.598934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:17.602380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:17.603057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:17.613652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:17.623188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:17.632911 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:17.632911 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:17.633809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:17.634251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:17.717578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fa6bfb4d-6e23-4d3b-be7b-99888acdd049 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108780 Nov 13 07:51:17.717578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 248/503] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:17 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:51:17.912107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:17.926093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:17.932279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:17.933373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0a26bb3f-493e-483c-a145-cf47a73f41c7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.367751 Nov 13 07:51:17.933884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 256/504] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:17 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:18.737512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:18.738714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:18.761016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:18.761465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:18.768478 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:18.770867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:18.848307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d338202d-de59-40e6-8a40-64feed633842 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124396 Nov 13 07:51:18.849084 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 249/505] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:18 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:18.957416 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:18.958720 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:18.967170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:18.967712 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:18.968706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:18.969338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:19.215944 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:19.233454 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:19.240611 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:19.242452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-09b053c4-f676-492d-ba28-6484b8b70bb8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.294058 Nov 13 07:51:19.243283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 257/506] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:18 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:19.899899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:19.906423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:19.930789 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:19.931490 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:19.932436 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:19.933021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:19.981455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1244542632", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:20.085435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bd366236-5850-41c9-85b4-5e9294fe40f7 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228325 Nov 13 07:51:20.085923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 250/507] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:19 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:20.106865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] validate_networks() for None {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:51:20.266791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:20.267709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:20.275643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:20.276333 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:20.277494 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:20.278224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:20.544320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:20.544900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:51:20.545322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:51:20.545791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:51:20.546198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:51:20.546610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:51:20.560936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:20.561385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:20.562182 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:20.562612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:20.566510 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:20.576701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:20.578125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f41d1bac-8e2b-4e2a-b3d4-84d8cd5191c1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.320886 Nov 13 07:51:20.586864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 251/508] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:20 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:20.603017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Getting quotas for project 0979a2d762514a79ae1fb25f00668882. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:51:20.613255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Getting quotas for user 370707c187a848d5b8fc1f6881f4a907 and project 0979a2d762514a79ae1fb25f00668882. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:51:20.628318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:51:20.631903 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:51:20.754229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8be09279-e592-4cc8-913c-c4638d6a04fa tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786597 Nov 13 07:51:20.755815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 258/509] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:51:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 13 07:51:20.772402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f9c16bdb-c088-4aaf-ab78-27dd3b191176 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:20.773427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f9c16bdb-c088-4aaf-ab78-27dd3b191176 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:20.991433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f9c16bdb-c088-4aaf-ab78-27dd3b191176 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:21.013644 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f9c16bdb-c088-4aaf-ab78-27dd3b191176 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1215 microversion: 2.1 time: 0.251838 Nov 13 07:51:21.016062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 252/510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:20 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:21.102545 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:21.104179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:21.112016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:21.112460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:21.113240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:21.113669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:21.191952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0d056f26-7118-4587-a78b-8e2b119af539 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099006 Nov 13 07:51:21.195846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 259/511] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:21 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:21.605737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:21.606355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:21.615196 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:21.615656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:21.616447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:21.616884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:21.983308 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:21.999881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:22.013231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:22.014388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d56ed8da-3f00-41d7-a446-5923fc521d53 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.419823 Nov 13 07:51:22.015268 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 253/512] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:21 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:22.040546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f1f347e1-231b-48af-a1bc-e24a0d753582 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:22.041313 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f1f347e1-231b-48af-a1bc-e24a0d753582 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:22.196231 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f1f347e1-231b-48af-a1bc-e24a0d753582 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:22.222631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:22.227152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f1f347e1-231b-48af-a1bc-e24a0d753582 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1215 microversion: 2.1 time: 0.197631 Nov 13 07:51:22.229222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:22.233389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 260/513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:22 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:22.254014 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:22.254474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:22.255292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:22.255728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:22.477908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cbeb2d8b-267e-4bf3-92b6-5b70df872365 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278123 Nov 13 07:51:22.480551 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 254/514] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:22 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:51:22.635898 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f5e0294-ebeb-4604-b988-dbd3c6d82273"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:22.637371 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:22.650509 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:22.651140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:22.652001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:22.652502 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:22.751324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Invalid volume: volume 3f5e0294-ebeb-4604-b988-dbd3c6d82273 already attached Nov 13 07:51:22.752673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 400 to user: Invalid volume: volume 3f5e0294-ebeb-4604-b988-dbd3c6d82273 already attached {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:51:22.753541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d9374053-af58-4d73-b6a6-5a6623f1e0a9 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.127568 Nov 13 07:51:22.754447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 261/515] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:51:22 2021] POST /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 120 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 13 07:51:23.043471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:23.053204 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:23.077021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:23.077590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:23.085568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:23.085808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:23.086067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:23.086763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:23.128630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:23.131129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:23.141235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:23.142084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:23.969068 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4dec160a-5dba-4ad0-a559-81ea68de8dca tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments/3f5e0294-ebeb-4604-b988-dbd3c6d82273" status: 202 len: 0 microversion: 2.1 time: 0.918720 Nov 13 07:51:23.971540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 262/516] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:51:23 2021] DELETE /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments/3f5e0294-ebeb-4604-b988-dbd3c6d82273 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:51:24.012402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:24.016923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:24.036171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.047353 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.049187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.049852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.194607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:24.234100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:24.243724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:24.245412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3c078ab8-0a0b-4a15-a5ff-75730e1c72b2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 1.214916 Nov 13 07:51:24.246385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 255/517] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:23 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:24.257628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:24.259343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:24.267977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.268704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.275291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.275744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.326232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:24.343757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-95a64c6e-4904-4082-a4b5-fd72bdb6a7ea tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1267 microversion: 2.1 time: 0.365583 Nov 13 07:51:24.344346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 263/518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:23 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1267 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:24.384435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:24.385422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:24.415694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.416174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.416979 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:24.417408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:24.450316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-54f62484-cff0-4926-a1e2-30a8be4c88c4 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199058 Nov 13 07:51:24.451244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 256/519] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:24 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:24.570950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-52b3486a-5dba-481f-989f-e82179af15d7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225485 Nov 13 07:51:24.572270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 264/520] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:24 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:25.274307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:25.275246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:25.282992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.283439 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.284761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.285428 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.370452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:25.380763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:25.400364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.400364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.400364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.400364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.844570 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:25.877040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:25.886005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:25.889915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-17dfd8cf-6d4b-4ddc-be46-163096ad2a55 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1273 microversion: 2.1 time: 0.532118 Nov 13 07:51:25.891945 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 265/521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:25 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1273 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:25.901106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:25.902259 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-27e31c3d-560b-4237-b62a-b904690c55d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.641500 Nov 13 07:51:25.903308 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 257/522] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:25 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:25.907265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:25.909178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:25.918664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.919351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.920310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.921235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.932896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:25.934016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:25.949569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.957630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:25.957630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:25.957630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.056883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3545d1dc-9403-4161-8d15-223c2a8692a5 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162696 Nov 13 07:51:26.058892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 266/523] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:25 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:26.083346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:26.087993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:26.103410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.103862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.104653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.105083 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.135184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c715b04e-1877-485b-874c-d5d8da3dd9a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230469 Nov 13 07:51:26.137066 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 258/524] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:25 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:26.237575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Going to try to terminate instance {{(pid=97388) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:51:26.802376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ff584990-af16-420f-b5a2-4347551022dd tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 204 len: 0 microversion: 2.1 time: 0.742192 Nov 13 07:51:26.803140 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 267/525] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:51:26 2021] DELETE /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:51:26.818625 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:26.820766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:26.837722 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.838586 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.840085 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.840736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.921032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:26.921909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:26.959262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.959798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:26.960805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:26.961595 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.175125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:27.194269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ace7e27b-1928-4c77-8707-de54ff7606c9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1273 microversion: 2.1 time: 0.283624 Nov 13 07:51:27.194269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 268/526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:26 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:27.205575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:27.206530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:27.237831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.238724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.239757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.240394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.327156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:27.345908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28510cc2-dd8e-4a9a-bb48-4a095607d95e tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1510 microversion: 2.1 time: 0.537994 Nov 13 07:51:27.346480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 259/527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:26 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1510 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:27.382150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:27.383208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:27.410765 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.411219 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.412017 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.412451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.586268 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-62b39aa7-31d3-4904-a827-6e4a8dc46e55 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.224017 Nov 13 07:51:27.603708 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 260/528] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:27 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8/os-volume_attachments => generated 25 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:51:27.625503 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:27.631814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:27.649662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.650389 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.652240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:27.654651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:27.795464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0405380f-593b-4d1c-bc1a-fc65cbba66a3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189446 Nov 13 07:51:27.807151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 261/529] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:27 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:28.107815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:28.124505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:28.159925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:28.161120 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a0cf9232-4c2d-4366-b675-c59cd5754cd8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1752 microversion: 2.20 time: 0.970089 Nov 13 07:51:28.161652 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 269/530] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:27 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1752 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:28.216179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:28.216723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:28.231129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.231578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.232463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.232949 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.369632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:28.373497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:28.381849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.382507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.383482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.383908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.393509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:28.408536 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4ac013bb-fbee-4e6d-9241-4c0a019016f0 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1273 microversion: 2.1 time: 0.206291 Nov 13 07:51:28.415090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 262/531] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:28 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:28.822503 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:28.823577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:28.850135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.850819 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.853339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:28.853788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:28.999991 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-36f61b71-f7f5-4bc9-bbd3-0f43cd3a07ba tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.189737 Nov 13 07:51:29.002806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 263/532] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:51:28 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347/os-volume_attachments => generated 25 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:51:29.195705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:29.196313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:29.220614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:29.221274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:29.221838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:29.222269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:29.619129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:29.659973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:29.682148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:29.691026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-627650a0-319e-4d52-a23f-6af034d19d25 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.504976 Nov 13 07:51:29.696980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 264/533] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:29 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:29.741002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2116479526", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "13dc6fb3-9bcb-4e4a-8416-084631603788"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:29.996725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:30.029809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-529a76e8-188f-40a1-8780-833646e1c014 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1510 microversion: 2.1 time: 1.670275 Nov 13 07:51:30.031064 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 270/534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:28 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1510 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:30.052171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:30.053126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:30.065092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:30.065786 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:30.066993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:30.067706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:31.508763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] validate_networks() for [('13dc6fb3-9bcb-4e4a-8416-084631603788', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:51:32.672884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:51:32.674168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:51:32.678492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:51:32.679344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:51:32.680154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:51:32.701070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:32.705233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:32.705233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:32.709782 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:32.781863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:51:32.787517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Getting quotas for user e0728501bcf8493a8704d5ca9f4dadf0 and project 9f0c482ef1eb4f8fa6c1320897c1678b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:51:32.808455 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:51:32.816504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:51:32.910648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:32.924409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bb50a0b6-ffa4-4d93-a583-8ea9eabc6255 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 2.891462 Nov 13 07:51:32.925221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 271/535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:30 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 2894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:32.960559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:32.961159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:32.973227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:32.978732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:32.980703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:32.981523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:33.088619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-68f93e7a-b82f-47bf-8f8c-73374b1ecdf1 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.390257 Nov 13 07:51:33.090711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 265/536] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:51:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 3393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:51:33.124138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:33.124642 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:33.163420 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:33.163889 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:33.164666 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:33.165112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:33.333825 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:51:33.884472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a87437fe-9cdd-4379-bd5a-75e8bdc2780a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 204 len: 0 microversion: 2.1 time: 0.792372 Nov 13 07:51:33.885510 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 266/537] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:51:33 2021] DELETE /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:51:33.897560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:33.920564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:33.939977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:33.940430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:33.941231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:33.941669 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.112086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.129709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6b7e9c0f-c04f-489a-8457-f9f25d14a00b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1301 microversion: 2.1 time: 0.242526 Nov 13 07:51:34.130788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 267/538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:33 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1301 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:34.160904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-92f6064c-cb14-401d-b36b-2a27623beaf2 req-739a0eea-354a-476d-8cd7-d49d18069b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce8f454-3e4d-4595-862a-cd01f1c66589", "name": "network-vif-deleted", "tag": "3523002e-6b2e-4520-942e-63bd11ed422e"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:34.169539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:34.169539 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:51:34.192385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-92f6064c-cb14-401d-b36b-2a27623beaf2 req-739a0eea-354a-476d-8cd7-d49d18069b06 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:34.200264 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-92f6064c-cb14-401d-b36b-2a27623beaf2 req-739a0eea-354a-476d-8cd7-d49d18069b06 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.239421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-92f6064c-cb14-401d-b36b-2a27623beaf2 req-739a0eea-354a-476d-8cd7-d49d18069b06 service nova] Creating event network-vif-deleted:3523002e-6b2e-4520-942e-63bd11ed422e for instance 0ce8f454-3e4d-4595-862a-cd01f1c66589 on hv-cinder-81783 Nov 13 07:51:34.245095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-92f6064c-cb14-401d-b36b-2a27623beaf2 req-739a0eea-354a-476d-8cd7-d49d18069b06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112726 Nov 13 07:51:34.247011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 268/539] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:34.278729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4140af6f-f7db-4c85-9296-b2791ddf38d8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:34.284500 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4140af6f-f7db-4c85-9296-b2791ddf38d8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:34.347603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.385295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.394178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.395694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9fa40434-99a7-46af-af30-75265d15016c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 1.469393 Nov 13 07:51:34.396429 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 272/540] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:32 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:34.422065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:34.423011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:34.441997 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:34.461029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.461029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:34.461029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.473987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4140af6f-f7db-4c85-9296-b2791ddf38d8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.483078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4140af6f-f7db-4c85-9296-b2791ddf38d8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1218 microversion: 2.1 time: 0.233878 Nov 13 07:51:34.484462 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 269/541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:34 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:34.497753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:34.498838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:34.542165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:34.542165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.542165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:34.542165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:34.807935 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:34.825830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-42c57ec5-2adb-426f-abf5-51489a0f00c8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.338786 Nov 13 07:51:34.828851 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 270/542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:34 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:34.998228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.014095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-af42ea23-3351-4aab-ab07-f6619e574930 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.616378 Nov 13 07:51:35.039241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 273/543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:34 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:35.161199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:35.161860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:35.169582 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.170042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.171237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.171672 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.280508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.281064 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.281535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:35.356582 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.374275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6449d230-1640-47cb-8e5d-4f645095a71d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.231804 Nov 13 07:51:35.378544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 271/544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:35 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:35.420559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:35.431582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:35.441006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.441799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.442826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.445740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.512978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:35.514099 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:35.555616 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.556024 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.560239 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.560691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.823355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.823355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-09ea2972-5b72-4432-b758-85872acf406a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.278082 Nov 13 07:51:35.823355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 272/545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:35 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:35.844581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.852150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:35.856011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:35.869941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.877440 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:35.878916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cbf82ca5-f7ca-4cce-9603-40631e5a0a1f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.467580 Nov 13 07:51:35.879139 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.879669 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:35.880543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:35.880697 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 274/546] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:35 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:35.886032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.057150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:36.058428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:36.081460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.082321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.083508 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.084123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.214086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:36.231590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-02e8cc26-5fb6-4b1f-82e8-28169f095f31 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.390209 Nov 13 07:51:36.243674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 273/547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:35 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:36.394737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-d68cd255-7562-41bd-bef2-044bb37a184a req-bf86ba0d-50ec-4cca-8bff-be34d35a77c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb3f02e-fff7-44aa-a951-2669c5ceccd4", "tag": "e1833c93-c15e-4d73-9d8f-fa620897a4e4"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:36.394737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:36.394737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:51:36.394737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-d68cd255-7562-41bd-bef2-044bb37a184a req-bf86ba0d-50ec-4cca-8bff-be34d35a77c2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.394737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-d68cd255-7562-41bd-bef2-044bb37a184a req-bf86ba0d-50ec-4cca-8bff-be34d35a77c2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.395615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-d68cd255-7562-41bd-bef2-044bb37a184a req-bf86ba0d-50ec-4cca-8bff-be34d35a77c2 service nova] Creating event network-changed:e1833c93-c15e-4d73-9d8f-fa620897a4e4 for instance bbb3f02e-fff7-44aa-a951-2669c5ceccd4 on hv-cinder-81783 Nov 13 07:51:36.395615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-d68cd255-7562-41bd-bef2-044bb37a184a req-bf86ba0d-50ec-4cca-8bff-be34d35a77c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053329 Nov 13 07:51:36.395615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 274/548] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:51:36.401152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:36.401979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:36.413063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.413666 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.414562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.415201 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.465987 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:36.477705 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-19d63848-75e0-4715-81f2-b921b323c8f0 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.433899 Nov 13 07:51:36.479682 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 275/549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:36 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:36.501782 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.502335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.502880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:36.616106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:36.621604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4f8fd15d-81f2-4b73-b26f-0685d617c0ac tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.231786 Nov 13 07:51:36.622271 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 275/550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:36 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:36.808159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:36.808159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:36.834479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.835170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.835962 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.836397 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.907162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:36.910661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:36.927435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.928185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:36.929245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:36.932039 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.002415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:37.011962 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b7377ee2-8205-40ca-85e9-70a149b3d595 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.222414 Nov 13 07:51:37.012833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 276/551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:36 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:37.179534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:37.194853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:37.201808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:37.206480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ee43b480-fac6-4bee-ad20-bc029627cc0b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.308157 Nov 13 07:51:37.206480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 276/552] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:36 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:51:37.270898 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:37.271803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:37.280887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.281533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.282353 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.282812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.503472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:37.545583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:37.545583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.545583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.545583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.546637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.646513 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:37.656686 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ffe2d934-096d-4850-bd92-4ffa637fc06a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.408482 Nov 13 07:51:37.666990 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 277/553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:37 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:37.680771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:37.681567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:37.691336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.692120 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.693092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.693681 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.839459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:37.840034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:37.843662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:38.070132 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.089136 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f7a366e1-ac4c-4d29-a64a-7bdd2b3e21cb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.419694 Nov 13 07:51:38.100117 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 278/554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:37 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:38.132499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:38.133488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:38.136166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.146150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.146919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.147926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.148520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.166150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2a91fc3f-3a51-4ae0-9302-c45dd8dae704 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.672495 Nov 13 07:51:38.171679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 277/555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:37 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:38.235372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:38.236419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:38.249567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.251830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.254117 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.255304 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.290638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.302142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f0964cf2-9c26-46ec-af4d-94eea82f5514 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.200388 Nov 13 07:51:38.303049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 279/556] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:38 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:38.684098 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:38.691563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:38.702277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.710420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.710420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:38.710420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:38.830290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 07:51:38.830775 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: Sat Nov 13 07:51:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 (ip 10.222.0.32) !!! Nov 13 07:51:38.877130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.927070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.933652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:38.942913 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28bfb0e7-6357-4702-b909-31b31b6dc34f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.716429 Nov 13 07:51:38.943537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 278/557] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:38 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:39.030960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:39.059632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6390939c-7895-46c7-9988-d25b7e0f9dd2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.388192 Nov 13 07:51:39.066282 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 280/558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:38 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:39.121474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:39.122076 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:39.139905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.140979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.142034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.142737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.198274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:39.199022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:39.215832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.216575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.217528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.218167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.259472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.259917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.263815 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:39.386257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:39.398943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-afe7fb2c-cdec-44b1-b598-11d001240858 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.294328 Nov 13 07:51:39.406401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 279/559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:39 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:39.440260 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:39.440880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:39.463915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.464370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.465867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.465867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.607336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:39.628737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4b36a7f5-1839-42fd-bc7e-8437f39b568c tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.433347 Nov 13 07:51:39.628737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 281/560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:39 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:39.673384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:39.683569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ca9daa77-1d2a-4e90-821f-c48c649e3733 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.275907 Nov 13 07:51:39.684119 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 280/561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:39 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:39.718772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:39.720762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:39.731461 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.732315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.733483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:39.737044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:39.968800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:39.969418 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:40.006118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.008442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.009524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.011590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.649368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:40.665013 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-31bd8bd2-089d-41bc-a015-d3087b3ee3ff tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments/83118019-f4a1-4453-9272-19a8fd6b1584" status: 202 len: 0 microversion: 2.1 time: 0.958519 Nov 13 07:51:40.666320 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 282/562] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:51:39 2021] DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments/83118019-f4a1-4453-9272-19a8fd6b1584 => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:51:40.668782 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:40.682619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:40.695280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2c4a03fd-5e56-4428-a14c-775614e2323d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.725903 Nov 13 07:51:40.695280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 281/563] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:39 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:40.695885 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:40.697002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:40.705553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.706040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.707114 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.707555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.738579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:40.740555 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:40.751937 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.752680 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.754924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.755539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.975769 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:40.976452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:40.976665 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:41.164215 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:41.183098 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2d0c4f85-c1a9-4520-a46e-07bed1e7dfdf tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.493459 Nov 13 07:51:41.183913 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 282/564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:40 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:41.201741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:41.202355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:41.210869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:41.228288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.228745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:41.229549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.229987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:41.235107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7da32311-90dd-4963-a180-dc0d57e65c10 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.566317 Nov 13 07:51:41.237431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 283/565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:40 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:41.256211 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:41.263555 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:41.280334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.281239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:41.282890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.283510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:41.472645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:41.482611 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ba647a2b-1d05-49ca-a612-4910faaf14d6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.243845 Nov 13 07:51:41.493660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 284/566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:41 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:41.646650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:41.655474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d162f76c-b37b-4876-b094-d7e1d9acf5c6 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.470477 Nov 13 07:51:41.656322 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 283/567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:41 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:41.709744 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:41.725996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:41.750259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.750259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:41.750259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:41.754589 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.154765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.169436 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.176451 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.180924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c03f5ef3-fe50-4a63-8e55-87f9b57e3b0c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.478474 Nov 13 07:51:42.180924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 285/568] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:41 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:42.208763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:42.210433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:42.218996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.219541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.222188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.222901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.266032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:42.267805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:42.298724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.299194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.300007 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.305517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.328855 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.330237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.331056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 0ce8f454-3e4d-4595-862a-cd01f1c66589 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:42.445292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.466465 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-672df03b-3d4e-44ba-9405-6d94ee168f36 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 200 len: 1306 microversion: 2.1 time: 0.268526 Nov 13 07:51:42.467832 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 284/569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:42 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:42.509793 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:42.510688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:42.534561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.534951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.535740 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:42.536169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:42.934496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.955157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5df4420b-6ed3-4ef4-99d4-47249e2d2001 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.704451 Nov 13 07:51:42.969181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 286/570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:42 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:42.970710 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:42.993677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e0f7048a-627e-49ac-9cae-e49fe147bd11 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1222 microversion: 2.1 time: 0.496627 Nov 13 07:51:42.995286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:43.006547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:43.006706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 285/571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:42 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1222 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:43.013942 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.015612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.018094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.021935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.212243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:43.213414 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:43.221858 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.222585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.223580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.224164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.626977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:43.662929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f78835e8-5734-41b0-b6bd-efb6ebfa483f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.692500 Nov 13 07:51:43.677567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 287/572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:42 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:43.711172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:43.713322 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 0ce8f454-3e4d-4595-862a-cd01f1c66589] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:43.738011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.738472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.739301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:43.739745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:43.800311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:43.850354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:43.867798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:43.871685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d56d841e-c367-4bb8-a8cc-eca963c87a8c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.678859 Nov 13 07:51:43.874783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 286/573] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:43 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:43.889262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] HTTP exception thrown: Instance 0ce8f454-3e4d-4595-862a-cd01f1c66589 could not be found. Nov 13 07:51:43.891266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Returning 404 to user: Instance 0ce8f454-3e4d-4595-862a-cd01f1c66589 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:51:43.895722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c6e5f1c5-5e1f-4e19-8daf-8444310d3074 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589" status: 404 len: 111 microversion: 2.1 time: 0.223107 Nov 13 07:51:43.899570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 288/574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:43 2021] GET /compute/v2.1/servers/0ce8f454-3e4d-4595-862a-cd01f1c66589 => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:51:43.987158 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:43.990396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:44.023609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:44.027400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.028933 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.029868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.030392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:44.067583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.130519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.131160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.131787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.137306 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.431010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:44.449332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-79cca741-7f90-4e5c-805d-762ab6a9a905 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1270 microversion: 2.1 time: 0.434654 Nov 13 07:51:44.458703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 289/575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:44 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1270 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:44.671050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:44.695646 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5e39579c-ff0c-40dc-8d29-dfd0e853ae6e tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.725523 Nov 13 07:51:44.706029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 287/576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:43 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:44.706298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:44.706298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:44.724503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.726787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.729820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.731212 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.935312 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:44.937187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:44.958445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.958862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:44.960003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:44.960445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:45.557474 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:45.569750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c7187ed6-198e-4ae6-8314-6ccf9146deba tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.887481 Nov 13 07:51:45.579379 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 290/577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:44 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:45.582309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b821075d-892f-4b4e-96fa-c17d27f083b8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:45.592696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b821075d-892f-4b4e-96fa-c17d27f083b8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:45.593319 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b821075d-892f-4b4e-96fa-c17d27f083b8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:45.739812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b821075d-892f-4b4e-96fa-c17d27f083b8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Going to try to stop instance {{(pid=97388) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Nov 13 07:51:45.777464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:45.807742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:45.817027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:45.818806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3345ac76-094c-4fac-80a3-9cf9c0e9bf24 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.907167 Nov 13 07:51:45.820093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 288/578] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:44 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:45.832734 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:45.834031 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:45.845532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:45.846377 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:45.847537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:45.848182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.102541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:46.102541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-79aceb81-e54c-46e7-a646-d1953adbc881 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1276 microversion: 2.1 time: 0.269906 Nov 13 07:51:46.102541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 289/579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:45 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:46.113655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:46.114277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:46.132434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.137896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.137896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.137896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.404385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b821075d-892f-4b4e-96fa-c17d27f083b8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 202 len: 0 microversion: 2.1 time: 0.832191 Nov 13 07:51:46.410647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 291/580] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:51:45 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:51:46.426375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:46.427150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:46.442713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.443265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.444060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.444490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.598611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:46.608070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bd07e5fd-8e3e-45c3-974a-ef4ae04f0469 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.514783 Nov 13 07:51:46.619234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 290/581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:46 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:46.631862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:46.632987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:46.644531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.645447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.646121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.646660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.973607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:46.973607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7afc7473-a7c0-4bc9-97a4-1ae7a36815d3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.469420 Nov 13 07:51:46.973607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 292/582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:46 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:46.973607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:46.974575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:46.974575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.974575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:46.974575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:46.974919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:47.117584 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:47.131985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:47.138583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:47.140157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d1b44de6-e52e-4a5d-a4e4-a5317ddfb3f9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.256065 Nov 13 07:51:47.140287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 293/583] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:46 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:47.150015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:47.150626 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:47.158934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:47.159381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:47.160159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:47.160588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:47.198434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:47.210444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5b97b59b-c3fe-4545-a9af-37c0c3d95014 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1507 microversion: 2.1 time: 0.588641 Nov 13 07:51:47.211516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 291/584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:46 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1507 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:47.533237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:47.546180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5ebc5848-cb90-4172-aaf7-6222cf7ed6d2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.404708 Nov 13 07:51:47.555773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 294/585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:47 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:47.633770 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:47.634474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:47.642894 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:47.643534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:47.644462 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:47.645041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:48.001735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:48.004993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:48.006590 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:48.016943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:48.017366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c9bcd200-4dc6-44b8-9914-b0f229e8db0a tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.395571 Nov 13 07:51:48.017923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:48.018902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:48.019561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:48.027368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 292/586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:47 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:48.601336 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Action: 'create', calling method: .version_select at 0x7f54efad71f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1192690175"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:48.673118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:51:48.691939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for user 42dd1924a1214e82984cbfcf7fe39f19 and project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:51:48.860220 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:48.882187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9c12a63f-ae34-47f3-81be-f81d315e330f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.895069 Nov 13 07:51:48.892407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 295/587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:47 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:48.910519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:48.915899 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:48.932528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:48.934915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:48.937032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:48.941525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.380848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:51:49.384967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for user 42dd1924a1214e82984cbfcf7fe39f19 and project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:51:49.400691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1d9a303c-3e67-45f9-b734-6bbda1944200 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.298352 Nov 13 07:51:49.405225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:49.406202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 293/588] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Nov 13 07:51:48 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:49.418706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:49.419300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:49.437221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.437221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.437221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.437221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.437687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:49.453335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:49.464099 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b675ca99-d804-49fb-a3b6-e5a598125e72 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.574716 Nov 13 07:51:49.465221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 296/589] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:48 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:49.476735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:49.489420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:49.505479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.508109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.509129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.509744 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.812830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:49.845872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9219a4f8-95f8-450d-9b95-a32b4d99b72a tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1465 microversion: 2.1 time: 0.437609 Nov 13 07:51:49.846448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 294/590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:49 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1465 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:49.862577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:49.885339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:49.897974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.898417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:49.911468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:49.919280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:50.188825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:50.197890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c3541b68-62ce-43b3-941a-353fe4886d01 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.731443 Nov 13 07:51:50.198658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 297/591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:49 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:50.209316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:50.212660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:50.220647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:50.221346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:50.222302 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:50.222981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:50.392281 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:50.413009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5c615815-34e2-4c8b-91c5-9557b7e95127 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.565435 Nov 13 07:51:50.423292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 295/592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:49 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:50.491674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:50.493319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:50.515341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:50.517363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:50.521172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:50.521908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:50.982373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:50.982960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:50.998100 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4b48acf5-f051-4ed4-9c47-66b3a0a2712b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.798167 Nov 13 07:51:51.007054 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:51.008890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:51.010067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-02e1be14-934c-444c-aac6-ad5e45ba20f0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.530435 Nov 13 07:51:51.010878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 298/593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:50 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:51.021147 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 296/594] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:50 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:51.032285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:51.032948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:51.042621 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-05c71361-bf92-4895-85ec-e1b3ebf8b396 req-ae492c86-465b-43c7-84af-91dc5d9a8d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc42cc46-fcd0-4091-89ee-f85d1bea1c09", "name": "network-vif-deleted", "tag": "339633cf-7225-4a17-a0e2-d529e386c0dc"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:51.042904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.043186 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.043983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.044630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.051867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:51.051867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:51:51.097512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-05c71361-bf92-4895-85ec-e1b3ebf8b396 req-ae492c86-465b-43c7-84af-91dc5d9a8d45 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.098141 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-05c71361-bf92-4895-85ec-e1b3ebf8b396 req-ae492c86-465b-43c7-84af-91dc5d9a8d45 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.133119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-05c71361-bf92-4895-85ec-e1b3ebf8b396 req-ae492c86-465b-43c7-84af-91dc5d9a8d45 service nova] Creating event network-vif-deleted:339633cf-7225-4a17-a0e2-d529e386c0dc for instance cc42cc46-fcd0-4091-89ee-f85d1bea1c09 on hv-cinder-81783 Nov 13 07:51:51.138332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-05c71361-bf92-4895-85ec-e1b3ebf8b396 req-ae492c86-465b-43c7-84af-91dc5d9a8d45 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124912 Nov 13 07:51:51.138973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 299/595] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:51.180640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.181361 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.182185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lazy-loading 'fault' on Instance uuid cc42cc46-fcd0-4091-89ee-f85d1bea1c09 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:51:51.238180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:51.241479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:51.275392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.276576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.280340 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.282519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.374373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:51.394512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d49644d2-b368-4c9a-87d1-68c4423f5fdd tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 200 len: 1311 microversion: 2.1 time: 0.372223 Nov 13 07:51:51.395086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 297/596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:51 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 1311 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:51.434466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:51.443062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:51.450271 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.451212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.452200 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.452793 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.705063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:51.715401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4368794d-fd29-4b7d-aaa5-1382f5d3640f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.289307 Nov 13 07:51:51.715989 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 298/597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:51 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:51.730285 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-860a0cd0-d15a-4a10-9cc8-b6c02f5471b4 req-f2b2924e-4859-4c0b-8fcd-eab78d10ef36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64f7c47-8d0f-436b-a8f1-0d0a76416ca8", "tag": "842792f1-dadf-4dda-9cd0-832261f0bb2d"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:51.735926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:51.735926 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:51:51.745138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-860a0cd0-d15a-4a10-9cc8-b6c02f5471b4 req-f2b2924e-4859-4c0b-8fcd-eab78d10ef36 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:51.745723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-860a0cd0-d15a-4a10-9cc8-b6c02f5471b4 req-f2b2924e-4859-4c0b-8fcd-eab78d10ef36 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:51.764827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-860a0cd0-d15a-4a10-9cc8-b6c02f5471b4 req-f2b2924e-4859-4c0b-8fcd-eab78d10ef36 service nova] Creating event network-changed:842792f1-dadf-4dda-9cd0-832261f0bb2d for instance e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 on hv-cinder-81783 Nov 13 07:51:51.771053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-860a0cd0-d15a-4a10-9cc8-b6c02f5471b4 req-f2b2924e-4859-4c0b-8fcd-eab78d10ef36 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053609 Nov 13 07:51:51.776051 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 299/598] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:51.950514 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:51.995600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c5438325-9135-4ecf-b517-efbaa3ab1f02 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.777752 Nov 13 07:51:51.997191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 300/599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:51 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:52.036097 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:52.037884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:52.073422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.073891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:52.074890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:52.075610 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.077186 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.079594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.095253 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.108416 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.114132 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.116833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.498187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:52.521205 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bab77ad6-376e-44cf-8596-5048886e107f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.508981 Nov 13 07:51:52.522492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 300/600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:52 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:52.533909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:52.534808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: cc42cc46-fcd0-4091-89ee-f85d1bea1c09] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:52.542624 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.543363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.544333 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.544942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.610569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] HTTP exception thrown: Instance cc42cc46-fcd0-4091-89ee-f85d1bea1c09 could not be found. Nov 13 07:51:52.611614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Returning 404 to user: Instance cc42cc46-fcd0-4091-89ee-f85d1bea1c09 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:51:52.613363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f0f66ea5-9604-4f0a-8932-8bc7f3fb9bde tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09" status: 404 len: 111 microversion: 2.1 time: 0.089705 Nov 13 07:51:52.614452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 301/601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:52 2021] GET /compute/v2.1/servers/cc42cc46-fcd0-4091-89ee-f85d1bea1c09 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:51:52.630930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:52.631749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:52.640312 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.640763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.641612 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.642048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.654172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:52.670484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:52.677523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:52.678991 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9e6d7c96-4b4d-4a1f-a3b7-0b81ac428dd1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.634490 Nov 13 07:51:52.679519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 301/602] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:52 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:52.712667 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:51:52.738256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:52.738853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:52.746211 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.746769 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:52.747573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:52.748000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.117582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:53.123292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bb15fbfe-b4ef-40c9-8560-1eb01cfd7419 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 204 len: 0 microversion: 2.1 time: 0.504617 Nov 13 07:51:53.130366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 302/603] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:51:52 2021] DELETE /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:51:53.139455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5691815d-dcf8-46cd-b952-6a1ad57068a2 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.410820 Nov 13 07:51:53.151798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 302/604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:52 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:53.162576 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:53.166267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:53.177755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:53.179572 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:53.190632 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.190891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.191184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.192000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.192430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.195800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.200868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.201565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.559335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:53.571891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-121c76a6-0833-4aef-9744-73e93c3dd373 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.418920 Nov 13 07:51:53.572708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 303/605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:53 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:53.587040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-c158c321-c6ab-4857-8f5b-6f0521748f31 req-efb98917-a8fc-45c9-bc1b-9445c50f7778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb3f02e-fff7-44aa-a951-2669c5ceccd4", "name": "network-vif-plugged", "status": "completed", "tag": "e1833c93-c15e-4d73-9d8f-fa620897a4e4"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:53.593395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:53.593395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:51:53.602495 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c158c321-c6ab-4857-8f5b-6f0521748f31 req-efb98917-a8fc-45c9-bc1b-9445c50f7778 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.603327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c158c321-c6ab-4857-8f5b-6f0521748f31 req-efb98917-a8fc-45c9-bc1b-9445c50f7778 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.623793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-c158c321-c6ab-4857-8f5b-6f0521748f31 req-efb98917-a8fc-45c9-bc1b-9445c50f7778 service nova] Creating event network-vif-plugged:e1833c93-c15e-4d73-9d8f-fa620897a4e4 for instance bbb3f02e-fff7-44aa-a951-2669c5ceccd4 on hv-cinder-81783 Nov 13 07:51:53.626365 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:53.631679 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-c158c321-c6ab-4857-8f5b-6f0521748f31 req-efb98917-a8fc-45c9-bc1b-9445c50f7778 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057149 Nov 13 07:51:53.632670 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 304/606] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:53.638549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae2bc08c-603e-42eb-ab19-6c3ae990e666 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.504176 Nov 13 07:51:53.639861 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 303/607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:53 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:53.647496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:53.648560 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:53.661335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.661335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.661335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.661335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.703920 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:53.704620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:53.713227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.713761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.714703 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:53.715210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:53.903893 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:53.918413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-20bcaf9e-e492-4f0f-a408-c355f1b8053b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.281996 Nov 13 07:51:53.929003 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 305/608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:53 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:54.007884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:54.023800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:54.029962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:54.031083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d9db4eba-f5bf-43dd-9538-201f6cb5eaee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.337617 Nov 13 07:51:54.032435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 304/609] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:53 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:54.166872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:54.167615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:54.177750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.178365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:54.179370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.179868 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:54.603790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:54.604953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:54.635497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.635497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:54.635497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.635497 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:54.670793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:54.685488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5ff374e2-1eac-4097-96c2-ee59deae76f9 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.530028 Nov 13 07:51:54.691637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 306/610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:54 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:54.710171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:54.718603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:54.731370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.735888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:54.739348 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:54.743926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.088743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.104018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f17f5077-c148-47f7-a9b4-6058370f5a86 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.518512 Nov 13 07:51:55.114135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 305/611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:54 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:51:55.137151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:55.137805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:55.146624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.163517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-830cd08c-931f-4da8-aded-779f78670b24 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.470601 Nov 13 07:51:55.163766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.163968 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.164964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.165564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.173570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 307/612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:54 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:55.210024 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:55.210647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:55.230836 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.231506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.232676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.233275 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.454506 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.464755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cd6b4fff-5f08-46fe-aea7-13e44b8c87b0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.358741 Nov 13 07:51:55.465960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 306/613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:55 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:55.691724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.718979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:55.719840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:55.721475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.731821 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.732380 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.736122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:55.736857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:55.738175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:55.739366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ee496e56-6fbb-4fad-9945-b2998b48f558 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.564764 Nov 13 07:51:55.741916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 308/614] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:55 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:56.130266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:56.135792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:56.181267 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:56.181955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:56.182606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:56.183076 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:56.235261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:56.274923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fce89a1a-1eee-47aa-ab59-627e0d51201f tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.570976 Nov 13 07:51:56.285244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 307/615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:55 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:56.309844 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:56.311448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:56.329622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:56.331574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:56.334129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:56.334759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:57.025255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:57.038984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1854c7c0-5614-4609-900b-9780574c564f tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.920774 Nov 13 07:51:57.066655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 309/616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:56 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:57.080861 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:57.083056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:57.087208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:57.098639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:57.101613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:57.102598 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:57.104139 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-83cbfc22-85db-4154-9206-56e32a73fbeb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.817240 Nov 13 07:51:57.104299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:57.113802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 308/617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:56 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:57.124169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-352718597", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "0e696668-3fa5-450f-a62d-42f1dbe4c6f1"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:57.404943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] validate_networks() for [('0e696668-3fa5-450f-a62d-42f1dbe4c6f1', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:51:57.428515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:57.449181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8474420c-16e3-4f66-81ab-174443501c7f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1679 microversion: 2.1 time: 0.390823 Nov 13 07:51:57.451702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 310/618] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:57 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1679 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:57.483895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:57.487222 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:57.497819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:57.499151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:57.501094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:57.501795 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:57.908250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:58.071640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:58.075292 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:58.076472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d22dff5f-2d40-4e27-9016-a1ff79fd2eaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.623612 Nov 13 07:51:58.087833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 311/619] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:57 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:51:58.103818 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:58.110655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:58.128230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.128827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.129770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.130473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.544323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:51:58.544825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:58.545765 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:51:58.546467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:51:58.547428 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:51:58.548093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:51:58.564946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c63f48d0-079f-4e30-b0f5-aaad27d6d79d tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1315 microversion: 2.1 time: 0.474982 Nov 13 07:51:58.574123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 312/620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:58 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:58.579351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.584998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.585556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.586146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.603295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:58.604331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:58.617411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.620293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.621933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.623249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:58.634525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Getting quotas for project 1157f51a4ae044748780b6818d3bef86. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:51:58.649055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Getting quotas for user 457263d3a89f452bb9faeb4becd60a75 and project 1157f51a4ae044748780b6818d3bef86. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:51:58.678605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:51:58.688544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:51:58.909981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c5944f44-ddda-480a-827b-1bf26b691c82 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794967 Nov 13 07:51:58.938661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 309/621] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:51:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:51:58.967154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:58.969641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:58.996980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:58.998523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.005300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.005870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.146551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:59.157874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f7a094ab-90a6-4e36-8c81-edf3258eeae9 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.590727 Nov 13 07:51:59.158924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 313/622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:58 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:59.173822 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:59.174867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:59.202602 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.206718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.208768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.210902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.477351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:59.494277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b252c5eb-7b3e-473e-9388-a11a462769da tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.554331 Nov 13 07:51:59.495232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 310/623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:58 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:59.505714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-90ea297d-28ee-431c-8a77-0062c1783c2c req-7931d8de-3c23-4ed3-80fa-5b16c30d4602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "name": "network-vif-plugged", "status": "completed", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:51:59.512682 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:51:59.512682 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:51:59.551900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-90ea297d-28ee-431c-8a77-0062c1783c2c req-7931d8de-3c23-4ed3-80fa-5b16c30d4602 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.552605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-90ea297d-28ee-431c-8a77-0062c1783c2c req-7931d8de-3c23-4ed3-80fa-5b16c30d4602 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.583794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-90ea297d-28ee-431c-8a77-0062c1783c2c req-7931d8de-3c23-4ed3-80fa-5b16c30d4602 service nova] Creating event network-vif-plugged:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:51:59.600292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-90ea297d-28ee-431c-8a77-0062c1783c2c req-7931d8de-3c23-4ed3-80fa-5b16c30d4602 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103475 Nov 13 07:51:59.601246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 311/624] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:51:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:51:59.620312 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b8cb843c-446f-410e-9dad-994a997146fe tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:59.621227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b8cb843c-446f-410e-9dad-994a997146fe tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:59.623688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:59.635444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c5c42a5e-def2-4d32-991a-23ee9d36c702 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1656 microversion: 2.1 time: 0.475336 Nov 13 07:51:59.636367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 314/625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:59 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1656 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:59.649551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:59.650633 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:59.660516 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.660967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.661934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.662414 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.739750 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b8cb843c-446f-410e-9dad-994a997146fe tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:51:59.751775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b8cb843c-446f-410e-9dad-994a997146fe tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1218 microversion: 2.1 time: 0.148982 Nov 13 07:51:59.761905 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 312/626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:59 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:51:59.773101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:51:59.773976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:51:59.783486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.787325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.787325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:51:59.787325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:51:59.994530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:00.033856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:00.048837 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:00.050012 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c3cd99ca-7a7c-4bbe-aafd-b3176661f576 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.411921 Nov 13 07:52:00.050608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 315/627] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:51:59 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:52:00.087080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4773bd79-b963-4a27-aaae-589fa04a1754 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:00.123777 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4773bd79-b963-4a27-aaae-589fa04a1754 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.123777 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4773bd79-b963-4a27-aaae-589fa04a1754 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.157559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:00.167657 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cf75ff01-4efd-45a5-bf80-98075aa4c4a8 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1465 microversion: 2.1 time: 0.404060 Nov 13 07:52:00.182133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 313/628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:51:59 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1465 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:00.195823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:00.203916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:00.206282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.207044 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.210800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.211374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.382149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4773bd79-b963-4a27-aaae-589fa04a1754 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Going to try to start instance {{(pid=97388) start /opt/stack/nova/nova/compute/api.py:2622}} Nov 13 07:52:00.692714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:00.719688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-878e16de-cb54-411f-8814-0371e3ab9876 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.519557 Nov 13 07:52:00.720640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 314/629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:00 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:00.736260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4773bd79-b963-4a27-aaae-589fa04a1754 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action" status: 202 len: 0 microversion: 2.1 time: 0.670917 Nov 13 07:52:00.741521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 316/630] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:52:00 2021] POST /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:52:00.741662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:00.741662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:00.754354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:00.755026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:00.758063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.758603 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.764296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.764296 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.764678 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.765313 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.766310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:00.767111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:00.888983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:52:01.152027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:01.170415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0f36607e-372a-4117-978f-5c5c3622fbac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.431773 Nov 13 07:52:01.181527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 317/631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:00 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:01.194296 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:01.195124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:01.206518 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.207226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.208187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.208728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.472107 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c14e4040-df9f-43d6-bbaf-e5a3cdf54271 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 204 len: 0 microversion: 2.1 time: 0.749629 Nov 13 07:52:01.472674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 315/632] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:52:00 2021] DELETE /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:52:01.489994 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:01.490749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:01.511981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.512432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.513228 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.513671 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.714849 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:01.724631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-46d5ae4d-b26c-4f05-87ca-48604bc78e8a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1222 microversion: 2.1 time: 0.250757 Nov 13 07:52:01.725520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 316/633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:01 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:01.766126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:01.767225 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:01.780470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.781676 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.782107 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.782556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.895136 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:01.909937 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-845da3b2-8a85-4f85-ac14-ffd0ab8531dc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1665 microversion: 2.1 time: 0.724629 Nov 13 07:52:01.910507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 318/634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:01 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1665 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:01.944340 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:01.944973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:01.963547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.964049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:01.964851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:01.965285 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.249635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:02.300569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:02.315950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:02.315950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e89015b0-e6a3-40b4-9cd0-627d29082475 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.589095 Nov 13 07:52:02.319169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 317/635] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:52:01 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:52:02.333026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:02.335405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:02.351475 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.352049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.352857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.353292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.416416 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:02.438376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-25b64cf8-6b69-4362-ac8b-17f0ddc1b8d6 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1471 microversion: 2.1 time: 0.514516 Nov 13 07:52:02.439170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 319/636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:01 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:02.462224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:02.466431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:02.492409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.493497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.501161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.505504 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.860263 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:02.863980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7175632d-290f-4b72-b893-d6635377dd98 tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1521 microversion: 2.1 time: 0.543683 Nov 13 07:52:02.873344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 318/637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:02 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:02.884654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:02.885814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:02.897071 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.899691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:02.899691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:02.899691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:03.077920 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:03.094711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7b21dc2b-9f3d-44b9-9ce1-386717c5c588 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1270 microversion: 2.1 time: 0.229108 Nov 13 07:52:03.110596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 319/638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:02 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:03.129910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'create', calling method: .version_select at 0x7f54efce20d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-558506700"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:03.212866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:52:03.224705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for user eb408642745e46549caee3557d68e44e and project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:52:03.803735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:52:03.815783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for user eb408642745e46549caee3557d68e44e and project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'key_pairs'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:52:03.855864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6b7c43d1-34d6-45f6-bd30-c225ce4ed01a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.743942 Nov 13 07:52:03.857946 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 320/639] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Nov 13 07:52:03 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:03.882618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:03.883435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:03.897778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:03.898253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:03.900824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:03.901367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.037134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:04.050889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0ae59604-b144-4493-9ee5-4ad4ca20c79c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 1.607168 Nov 13 07:52:04.061401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 320/640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:02 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:04.084141 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:04.085080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:04.098435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.100814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.103870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.103870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.715831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:04.726003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-74939a84-6987-4d29-b467-2691029f517e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1665 microversion: 2.1 time: 0.866635 Nov 13 07:52:04.727071 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 321/641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:03 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1665 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:04.751749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:04.755924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:04.770260 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.771120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.772421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.775080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.820041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:04.839694 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:04.847199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:04.848857 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-17cb32a6-92f5-45b4-810b-14d7b80947d5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1808 microversion: 2.20 time: 0.784401 Nov 13 07:52:04.863047 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 321/642] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:52:04 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1808 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:52:04.874354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:04.875561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:04.883665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.884123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:04.884921 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:04.885364 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.129347 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:05.152861 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7ced8776-6648-4fe0-8280-c3d3247688ac tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1479 microversion: 2.1 time: 0.288631 Nov 13 07:52:05.153418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 322/643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:04 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1479 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:05.173191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1208501311", "imageRef": "9fceb03b-a024-40f2-81b4-17dd0af88ae0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-558506700", "networks": [{"uuid": "33b2e2eb-bc05-4987-b5c8-b2b3975db61e"}]}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:05.243774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:05.254814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4c7225b5-b5a7-4478-ac81-9c10f82194be tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1471 microversion: 2.1 time: 0.525132 Nov 13 07:52:05.256209 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 322/644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:04 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1471 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:05.260224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] validate_networks() for [('33b2e2eb-bc05-4987-b5c8-b2b3975db61e', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:52:05.272368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:05.273316 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:05.281661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.289247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.289247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.289247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.410541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:05.424364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6d9be6f6-c8d7-4dc9-963d-fb3038aa47ca tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1276 microversion: 2.1 time: 0.165497 Nov 13 07:52:05.424916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 323/645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:05 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:05.434556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-bc3318d7-6fe1-4fb5-b209-4abacc3e5f9a req-0b35b1c1-1766-43ca-9c00-eb2710b8850f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64f7c47-8d0f-436b-a8f1-0d0a76416ca8", "name": "network-vif-plugged", "status": "completed", "tag": "842792f1-dadf-4dda-9cd0-832261f0bb2d"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:05.440821 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:05.440821 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:05.448950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-bc3318d7-6fe1-4fb5-b209-4abacc3e5f9a req-0b35b1c1-1766-43ca-9c00-eb2710b8850f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.449583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-bc3318d7-6fe1-4fb5-b209-4abacc3e5f9a req-0b35b1c1-1766-43ca-9c00-eb2710b8850f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.469729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-bc3318d7-6fe1-4fb5-b209-4abacc3e5f9a req-0b35b1c1-1766-43ca-9c00-eb2710b8850f service nova] Creating event network-vif-plugged:842792f1-dadf-4dda-9cd0-832261f0bb2d for instance e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 on hv-cinder-81783 Nov 13 07:52:05.476184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-bc3318d7-6fe1-4fb5-b209-4abacc3e5f9a req-0b35b1c1-1766-43ca-9c00-eb2710b8850f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049794 Nov 13 07:52:05.477565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 324/646] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:05.490372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:05.491113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:05.502200 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.502658 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.503482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.503918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.902577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:05.917095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f528a3f9-a56d-4c47-9b47-a9ca4319a851 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.432824 Nov 13 07:52:05.917095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 325/647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:05 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:05.927483 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-6da63e67-7b3c-4a67-b539-ddafb1803ae7 req-51fd5596-a4a1-4df0-9646-1cd179b6efde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8908876f-0fbb-43e5-861d-16599dc0dbf8", "name": "network-vif-deleted", "tag": "c4fea12e-1c32-4d53-af69-c60642a069fd"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:05.933869 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:05.933869 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:05.945609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-6da63e67-7b3c-4a67-b539-ddafb1803ae7 req-51fd5596-a4a1-4df0-9646-1cd179b6efde service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:05.948105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-6da63e67-7b3c-4a67-b539-ddafb1803ae7 req-51fd5596-a4a1-4df0-9646-1cd179b6efde service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:05.994004 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-6da63e67-7b3c-4a67-b539-ddafb1803ae7 req-51fd5596-a4a1-4df0-9646-1cd179b6efde service nova] Creating event network-vif-deleted:c4fea12e-1c32-4d53-af69-c60642a069fd for instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 on hv-cinder-81783 Nov 13 07:52:05.998432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-6da63e67-7b3c-4a67-b539-ddafb1803ae7 req-51fd5596-a4a1-4df0-9646-1cd179b6efde service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084596 Nov 13 07:52:05.999270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 326/648] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:06.010011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:06.010731 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:06.018267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.018754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.019548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.019984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.381523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:52:06.382584 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:52:06.383280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:52:06.383856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:52:06.384537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:52:06.395810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.396486 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.397415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.397899 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.418163 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:52:06.422525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Getting quotas for user eb408642745e46549caee3557d68e44e and project 7bf786a8e1ef481fa4403ec4489a3c6d. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:52:06.433599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:52:06.435905 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fceb03b-a024-40f2-81b4-17dd0af88ae0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:52:06.550349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:06.567840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a742d27d-9c23-4b12-a5b3-aedf1fac3fe9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1669 microversion: 2.1 time: 0.567199 Nov 13 07:52:06.573432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 327/649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:05 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1669 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:06.589576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-12d6480b-7fa0-42c0-8fe9-13122719a307 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431652 Nov 13 07:52:06.590217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 323/650] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:52:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:52:06.598276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:06.601509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:06.611443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:06.612185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:06.626796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.627538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.628500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.629921 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.636158 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.636716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.637585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.638088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.728308 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.728770 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.729225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lazy-loading 'fault' on Instance uuid 8908876f-0fbb-43e5-861d-16599dc0dbf8 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:52:06.912177 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995ddf27861448bc9b5188538792df77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1f9a1ba6464c57932a7fbff537dd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:06.919535 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-01b35b56-6ef6-4be2-8ce8-b32b1f8daede tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 200 len: 1311 microversion: 2.1 time: 0.323345 Nov 13 07:52:06.920056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 324/651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:06 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 1311 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:06.943422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:06.944282 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:06.955394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.955749 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:06.956722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:06.957303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.039312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.039767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.040206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lazy-loading 'fault' on Instance uuid bbb3f02e-fff7-44aa-a951-2669c5ceccd4 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:52:07.107482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.129998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.137628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.138994 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c10080ed-64d4-4ee4-9f5e-6d10a942aa80 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1795 microversion: 2.20 time: 0.564358 Nov 13 07:52:07.140034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 328/652] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:52:06 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1795 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:52:07.177344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:07.177344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:07.183172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.183702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.184580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.185086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.246513 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370707c187a848d5b8fc1f6881f4a907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0979a2d762514a79ae1fb25f00668882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.261833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7c5d07d7-86e0-4cbb-8fb8-40be16582a98 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 200 len: 1305 microversion: 2.1 time: 0.333478 Nov 13 07:52:07.262654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 325/653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:06 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 1305 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:07.273643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5711feaa-4b29-419a-8b0f-f4c6d338ff92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:07.274561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5711feaa-4b29-419a-8b0f-f4c6d338ff92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:07.356034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5711feaa-4b29-419a-8b0f-f4c6d338ff92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.365147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5711feaa-4b29-419a-8b0f-f4c6d338ff92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1258 microversion: 2.1 time: 0.100645 Nov 13 07:52:07.365690 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 326/654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:07 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1258 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:07.375445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:07.376048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:07.383798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.384413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.385295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.385906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.570449 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.579434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-31cb20a2-735a-4a81-9684-da91d9d92dea tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.438000 Nov 13 07:52:07.583953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 329/655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:07 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:07.605596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-09dd0914-b67d-4c5b-b8e1-0a388229bdcf req-36e4053d-a05f-489a-80ca-0cc9cbcabf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ac6e01-c355-4ef0-bc3a-efbff58658c4", "tag": "ff95e79a-d2c3-4508-a5d2-1a99bf8900f7"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:07.623833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:07.623833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:07.635541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-09dd0914-b67d-4c5b-b8e1-0a388229bdcf req-36e4053d-a05f-489a-80ca-0cc9cbcabf61 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.635541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-09dd0914-b67d-4c5b-b8e1-0a388229bdcf req-36e4053d-a05f-489a-80ca-0cc9cbcabf61 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.650508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-09dd0914-b67d-4c5b-b8e1-0a388229bdcf req-36e4053d-a05f-489a-80ca-0cc9cbcabf61 service nova] Creating event network-changed:ff95e79a-d2c3-4508-a5d2-1a99bf8900f7 for instance 39ac6e01-c355-4ef0-bc3a-efbff58658c4 on hv-cinder-81783 Nov 13 07:52:07.655255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-09dd0914-b67d-4c5b-b8e1-0a388229bdcf req-36e4053d-a05f-489a-80ca-0cc9cbcabf61 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073543 Nov 13 07:52:07.656601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 330/656] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:07.708952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:07.723305 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4d83844b-e10d-46d5-ab12-74a8a629cd25 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1318 microversion: 2.1 time: 0.356566 Nov 13 07:52:07.724407 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 327/657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:07 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:07.944507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:07.945206 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] [instance: 8908876f-0fbb-43e5-861d-16599dc0dbf8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:07.953620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.954018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:07.954809 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:07.955245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.005460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] HTTP exception thrown: Instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 could not be found. Nov 13 07:52:08.005950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] Returning 404 to user: Instance 8908876f-0fbb-43e5-861d-16599dc0dbf8 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:52:08.006794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-33358a45-1796-40e5-b13c-12e15503201e tempest-ServerRescueNegativeTestJSON-1676575134 tempest-ServerRescueNegativeTestJSON-1676575134-project] 10.222.0.32 "GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8" status: 404 len: 111 microversion: 2.1 time: 0.073527 Nov 13 07:52:08.007341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 331/658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:07 2021] GET /compute/v2.1/servers/8908876f-0fbb-43e5-861d-16599dc0dbf8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:52:08.088187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ce9fc89d-b6a4-423b-92cb-585a4c4b1364 req-f53cfe2e-e3a0-4787-aa53-a4fd05890bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb3f02e-fff7-44aa-a951-2669c5ceccd4", "name": "network-vif-deleted", "tag": "e1833c93-c15e-4d73-9d8f-fa620897a4e4"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:08.094638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:08.094638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:52:08.103765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ce9fc89d-b6a4-423b-92cb-585a4c4b1364 req-f53cfe2e-e3a0-4787-aa53-a4fd05890bb0 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.104432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ce9fc89d-b6a4-423b-92cb-585a4c4b1364 req-f53cfe2e-e3a0-4787-aa53-a4fd05890bb0 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.123851 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ce9fc89d-b6a4-423b-92cb-585a4c4b1364 req-f53cfe2e-e3a0-4787-aa53-a4fd05890bb0 service nova] Creating event network-vif-deleted:e1833c93-c15e-4d73-9d8f-fa620897a4e4 for instance bbb3f02e-fff7-44aa-a951-2669c5ceccd4 on hv-cinder-81783 Nov 13 07:52:08.129687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ce9fc89d-b6a4-423b-92cb-585a4c4b1364 req-f53cfe2e-e3a0-4787-aa53-a4fd05890bb0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054458 Nov 13 07:52:08.131201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 328/659] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:08.286442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:08.287156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] [instance: bbb3f02e-fff7-44aa-a951-2669c5ceccd4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:08.295009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.295462 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.296246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.296711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.347108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] HTTP exception thrown: Instance bbb3f02e-fff7-44aa-a951-2669c5ceccd4 could not be found. Nov 13 07:52:08.351487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] Returning 404 to user: Instance bbb3f02e-fff7-44aa-a951-2669c5ceccd4 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:52:08.351487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c15a3bb3-90d9-4c1d-9766-5991f46d44e3 tempest-VolumesNegativeTest-536078666 tempest-VolumesNegativeTest-536078666-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4" status: 404 len: 111 microversion: 2.1 time: 0.072020 Nov 13 07:52:08.351487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 332/660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:08 2021] GET /compute/v2.1/servers/bbb3f02e-fff7-44aa-a951-2669c5ceccd4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:52:08.393091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:08.394788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:08.404151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.404724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.405587 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.406265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.603184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:08.604735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:08.606207 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:08.618359 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.619033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.619996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.620598 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.626264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b5fa678a-c465-4f24-ac98-ef8d0253248c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1262 microversion: 2.1 time: 0.246513 Nov 13 07:52:08.638864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 329/661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:08 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1262 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:08.746821 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:08.747648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:08.756378 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.757149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:08.758067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:08.758596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:09.194344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:09.204447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e5f39777-80d9-49bc-9274-aafa99ac024e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1507 microversion: 2.1 time: 0.466368 Nov 13 07:52:09.205119 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:09.214409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 330/662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:08 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:09.226446 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dd41b57b-6ace-4ef4-88ac-151b8a8f6b27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.633036 Nov 13 07:52:09.226569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 333/663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:08 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:09.650445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:09.653839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:09.659277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:09.659755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:09.660646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:09.661300 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:09.848275 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:09.865334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c3338691-cf1a-46b3-bea2-683b140420c5 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1310 microversion: 2.1 time: 0.224566 Nov 13 07:52:09.875832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 331/664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:09 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1310 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:10.257516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:10.258702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:10.267396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:10.267985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:10.268868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:10.269396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:10.680962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:10.691955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b9b7b2f9-95cd-48a4-9754-18f515e4c5d2 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.451620 Nov 13 07:52:10.693188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 334/665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:10 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:10.888931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:10.889539 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:10.899888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:10.900591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:10.901793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:10.902430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:11.067609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:11.077283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1fc809d9-2084-4375-9b21-d0d53d41c9e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1316 microversion: 2.1 time: 0.197511 Nov 13 07:52:11.079118 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 332/666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:10 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:11.342960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cd2510b-e136-4fdc-a8a3-04825d32689a"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:11.352284 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:11.370500 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:11.370978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:11.371829 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:11.372502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:11.834742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:11.834742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:11.834742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:11.834742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:11.837120 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:11.837120 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:12.172243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:12.182856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-89c5cb43-f139-4769-a7d4-ee43206df6b8 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.476016 Nov 13 07:52:12.184227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 333/667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:11 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:12.209221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:12.210321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:12.218707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:12.219441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:12.223741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:12.237915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:12.655250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:12.676710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-61cdd3ac-d859-4f36-87f0-89b2a8d54c8b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.491161 Nov 13 07:52:12.677904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 334/668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:12 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:13.209769 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:13.219714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:13.239711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:13.240955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:13.243647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:13.244490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:13.592356 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:13.601399 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-127914a9-0c23-49a5-91a6-e5dec52b97c3 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.404073 Nov 13 07:52:13.611832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 335/669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:13 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:13.701636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:13.702789 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:13.710565 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:13.711045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:13.711823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:13.712338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:14.019354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:14.028316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7410bdba-494c-492f-9ad9-5966fb2cf09e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.337454 Nov 13 07:52:14.033079 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 336/670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:13 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:14.626082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:14.626867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:14.644274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:14.647243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:14.648187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:14.648843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:14.939620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:14.950699 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ddf2526c-0ebf-4004-a1c8-f208de22684c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.334385 Nov 13 07:52:14.961312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 337/671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:14 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:15.051762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:15.052374 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:15.060585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:15.061073 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:15.061863 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:15.062878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:15.595885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:15.604746 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bffe55c2-0f65-4a52-ae5f-321b95d21614 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.562750 Nov 13 07:52:15.605608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 338/672] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:15 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:15.628856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-391288816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1192690175", "security_groups": [{"name": "tempest-secgroup-smoke-465628113"}], "networks": [{"uuid": "0f66ae5e-e9e4-42e2-9f8e-0271fe49488b"}], "block_device_mapping_v2": [{"uuid": "32f557fa-5ab0-48dd-ad2f-19df625767c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:15.948963 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] validate_networks() for [('0f66ae5e-e9e4-42e2-9f8e-0271fe49488b', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:52:17.099008 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:52:17.099560 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:52:17.099835 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:52:17.100239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:52:17.100648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:52:17.124446 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:17.125181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:17.126151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:17.128580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:17.147721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:52:17.152716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Getting quotas for user 42dd1924a1214e82984cbfcf7fe39f19 and project fa4e1d8ace6b4f22816be1ee49b861bb. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:52:17.302040 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:52:17.304263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32f557fa-5ab0-48dd-ad2f-19df625767c7',volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:52:17.849146 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-255cef55-8f55-446f-9d1a-a0c1c54acf31 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.242494 Nov 13 07:52:17.849708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 339/673] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:52:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:52:17.866492 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:17.867808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:17.878359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:17.878914 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:17.879704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:17.880188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:18.118199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:18.127246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-792b1f2e-842d-4483-ba1d-bc0131eedce4 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.276500 Nov 13 07:52:18.136829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 340/674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:17 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:18.147910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-058086d6-3fe8-4db1-b46b-8bdafcd7b3ad req-2ee64848-5bda-4357-ad31-8313aabb7a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ac6e01-c355-4ef0-bc3a-efbff58658c4", "name": "network-vif-plugged", "status": "completed", "tag": "ff95e79a-d2c3-4508-a5d2-1a99bf8900f7"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:18.154960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:18.154960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:52:18.163202 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-058086d6-3fe8-4db1-b46b-8bdafcd7b3ad req-2ee64848-5bda-4357-ad31-8313aabb7a08 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:18.163859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-058086d6-3fe8-4db1-b46b-8bdafcd7b3ad req-2ee64848-5bda-4357-ad31-8313aabb7a08 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:18.184445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-058086d6-3fe8-4db1-b46b-8bdafcd7b3ad req-2ee64848-5bda-4357-ad31-8313aabb7a08 service nova] Creating event network-vif-plugged:ff95e79a-d2c3-4508-a5d2-1a99bf8900f7 for instance 39ac6e01-c355-4ef0-bc3a-efbff58658c4 on hv-cinder-81783 Nov 13 07:52:18.190490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-058086d6-3fe8-4db1-b46b-8bdafcd7b3ad req-2ee64848-5bda-4357-ad31-8313aabb7a08 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052133 Nov 13 07:52:18.193576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 341/675] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:18.202254 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:18.203138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:18.210951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:18.213408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:18.216710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:18.216710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:18.440312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:18.455566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d05896fd-4ff9-4be2-9fde-b94ddf804386 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.262883 Nov 13 07:52:18.466479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 342/676] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:18 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:18.480948 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4ffedbc6-d3bf-4bb2-a5d9-da7623254760 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:18.481570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4ffedbc6-d3bf-4bb2-a5d9-da7623254760 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:18.586101 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4ffedbc6-d3bf-4bb2-a5d9-da7623254760 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:18.601796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4ffedbc6-d3bf-4bb2-a5d9-da7623254760 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1088 microversion: 2.1 time: 0.134193 Nov 13 07:52:18.602365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 343/677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:18 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1088 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:19.151944 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:19.153994 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:19.163904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.169961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.169961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.169961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.454000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:19.467453 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ecf97730-c5c9-4600-b28e-fb5a8966a71b tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.324302 Nov 13 07:52:19.468823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 344/678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:19 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:19.480490 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:19.481762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:19.490208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.491066 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.492365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.492992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.808679 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:19.818148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-db16250c-3c33-40cd-9ce9-f404a85e1f79 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.347975 Nov 13 07:52:19.818719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 345/679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:19 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:19.830581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:19.834156 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:19.838748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.839212 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.840155 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:19.840588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:19.991556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:20.001096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-48427fb4-804d-4952-ba87-5f1738e27b90 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1138 microversion: 2.1 time: 0.180928 Nov 13 07:52:20.001642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 346/680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:19 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1138 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:20.490297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:20.491634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:20.499050 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:20.499734 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:20.500702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:20.501292 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:20.744731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:20.760769 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-026901a5-9ad7-4c96-bd35-6eaf2a1165bb tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.279791 Nov 13 07:52:20.761671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 347/681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:20 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:20.842196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:20.842865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:20.851102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:20.851558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:20.852339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:20.852777 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:21.071877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:21.087052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-aed9a744-45b7-42b2-a9ab-af4918ce1ef9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.249290 Nov 13 07:52:21.087052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 348/682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:20 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:21.097496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:21.098252 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:21.105597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:21.106039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:21.106880 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:21.107309 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:21.233583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:21.242825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f9701c2e-25d9-41ce-9b3c-387588d6e9fd tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1138 microversion: 2.1 time: 0.160287 Nov 13 07:52:21.243750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 349/683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:21 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1138 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:21.783328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:21.783992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:21.792183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:21.792645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:21.793434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:21.793878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:22.093127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:22.106693 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3e042f08-b9c9-4c67-bee4-dad11fb3a756 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.332853 Nov 13 07:52:22.118068 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 350/684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:21 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:22.119201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:22.119892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:22.128448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:22.129130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:22.130160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:22.130911 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:22.373096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:22.382504 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1bd605e0-6bf7-4454-a924-87427c440897 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.273551 Nov 13 07:52:22.392834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 351/685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:22 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:22.405976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:22.408973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:22.415166 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:22.415624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:22.416416 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:22.416846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:22.554024 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:22.562717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-67a017bf-3430-4001-a8b7-0908872590c0 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1138 microversion: 2.1 time: 0.168665 Nov 13 07:52:22.563730 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 352/686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:22 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1138 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:23.131699 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:23.132332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:23.139534 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.140029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:23.140818 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.141882 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:23.482970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:23.494642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ad2963e1-2a06-4270-9e64-c6b502674968 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.373268 Nov 13 07:52:23.495456 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 353/687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:23 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:23.525225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:23.539240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:23.543696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.544331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:23.545282 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.545888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:23.774686 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:23.783956 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a702a8c5-c292-4e14-8e51-1c0a9727b304 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.286836 Nov 13 07:52:23.793330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 354/688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:23 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:23.794950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:23.795586 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:23.804270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.804728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:23.805520 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:23.805960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.130317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:24.161926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e97317c3-5dcd-45bf-9400-45245fff95b2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1130 microversion: 2.1 time: 0.376223 Nov 13 07:52:24.164241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 355/689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:23 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1130 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:24.519673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:24.520572 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:24.528819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:24.529280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.530072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:24.530507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.641770 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5fbbc850-8f16-4897-aea8-e55827df2d65 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "POST /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.308568 Nov 13 07:52:24.648532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 335/690] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:52:11 2021] POST /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 194 bytes in 13316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:24.776219 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-09042243-c090-4d7a-b50b-d93a533981ec req-dbed4ccc-1600-40d4-855b-d28cd6f19479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:24.783528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:24.783528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:24.811174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-09042243-c090-4d7a-b50b-d93a533981ec req-dbed4ccc-1600-40d4-855b-d28cd6f19479 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:24.812124 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-09042243-c090-4d7a-b50b-d93a533981ec req-dbed4ccc-1600-40d4-855b-d28cd6f19479 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.855254 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-09042243-c090-4d7a-b50b-d93a533981ec req-dbed4ccc-1600-40d4-855b-d28cd6f19479 service nova] Creating event network-changed:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:52:24.861009 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-09042243-c090-4d7a-b50b-d93a533981ec req-dbed4ccc-1600-40d4-855b-d28cd6f19479 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118562 Nov 13 07:52:24.862511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 336/691] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:52:24.878342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:24.879931 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:24.888419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:24.889141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.890132 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:24.891392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:24.985993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:25.025318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e41a3105-d753-4e55-b65e-6fc738b2f51d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.502573 Nov 13 07:52:25.025318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 356/692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:24 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:25.198879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:25.199931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:25.217501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:25.220106 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:25.221249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:25.222215 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:25.367175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:25.376284 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-98729cd3-76e2-4a0b-b341-9535b713f246 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1186 microversion: 2.1 time: 0.200099 Nov 13 07:52:25.376836 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 357/693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:25 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1186 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:26.029571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:26.041643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8dc422fb-4817-47a7-a991-5aa36b6fec4b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 1.178700 Nov 13 07:52:26.042195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 337/694] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:24 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:26.050596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:26.051513 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:26.059435 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:26.063326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:26.063326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:26.063326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:26.404244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:26.404858 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:26.408087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:26.417781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d642e324-7d2a-4a90-a8c5-7d1446661974 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1318 microversion: 2.1 time: 0.380083 Nov 13 07:52:26.418931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 358/695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:26 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:26.420970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:26.421438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:26.423049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:26.423508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:26.910090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:26.918019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7259f880-55ae-4e6c-b8a3-148336eb6ec2 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1194 microversion: 2.1 time: 0.528984 Nov 13 07:52:26.918555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 338/696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:26 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:27.066581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:27.066581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:27.073774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.074472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.075491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.076158 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.313802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:27.322059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f4935c03-3494-4e3c-87ed-17efc992726e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.267939 Nov 13 07:52:27.322588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 359/697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:27 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:27.440915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:27.441517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:27.449212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.449631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.450460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.451056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.675231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:27.683777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-edef6b94-76a2-46e7-9ba8-744c42795838 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1506 microversion: 2.1 time: 0.252413 Nov 13 07:52:27.684369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 339/698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:27 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:27.706399 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40d34cf8-14b7-4be9-9ad7-2f3e021d6d0d", "device": "/dev/sdb"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:27.707983 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:27.715352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.721349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.721349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.721349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.942049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:27.942795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:27.950301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.951032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:27.951818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:27.952254 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:28.267925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:28.276575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f0872238-9343-412b-8c6d-8c44ede6bb20 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.344951 Nov 13 07:52:28.277109 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 340/699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:27 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:28.345461 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:28.346066 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:28.353537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:28.353845 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:28.354717 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:28.355078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:28.642445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:28.673286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ba82c99e-fafe-4412-8a47-c4032109c5c9 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.337590 Nov 13 07:52:28.682720 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 341/700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:28 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:28.906137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-22f9d7c5-2c12-4757-bbbc-5d23896ecc41 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "POST /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209379 Nov 13 07:52:28.907504 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 360/701] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:52:27 2021] POST /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4/os-volume_attachments => generated 194 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:29.026338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-655432fa-d977-4e44-89c4-2f9f41a0c5b0 req-b55b7139-3820-483f-93d0-75ff2e6525d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:29.033751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:29.033751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:29.042372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-655432fa-d977-4e44-89c4-2f9f41a0c5b0 req-b55b7139-3820-483f-93d0-75ff2e6525d2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:29.042848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-655432fa-d977-4e44-89c4-2f9f41a0c5b0 req-b55b7139-3820-483f-93d0-75ff2e6525d2 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:29.064095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-655432fa-d977-4e44-89c4-2f9f41a0c5b0 req-b55b7139-3820-483f-93d0-75ff2e6525d2 service nova] Creating event network-changed:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:52:29.072006 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-655432fa-d977-4e44-89c4-2f9f41a0c5b0 req-b55b7139-3820-483f-93d0-75ff2e6525d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054134 Nov 13 07:52:29.072512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 342/702] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:29.299858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:29.301137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:29.309641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:29.310094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:29.317026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:29.317026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:29.697160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:29.698038 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:29.705342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:29.705789 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:29.706561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:29.707025 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:29.799156 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:29.809109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9664a20c-1ef6-4965-bd11-3ea6123a9591 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.519484 Nov 13 07:52:29.809671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 361/703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:29 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:29.924183 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:29.934109 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-629b3355-1943-4975-8197-382c541fb428 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.246885 Nov 13 07:52:29.934823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 343/704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:29 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:30.831396 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:30.832090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:30.840508 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:30.841187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:30.842006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:30.842473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:30.956444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:30.957049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:30.964973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:30.965507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:30.966226 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:30.967005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:31.092653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:31.102480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8da63604-36bb-4417-a4a3-daac50d60960 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.280923 Nov 13 07:52:31.103164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 362/705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:30 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:31.204516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:31.209407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1dc7db8f-24a3-46ab-b5d5-c33a3a810f49 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.262200 Nov 13 07:52:31.209939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 344/706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:30 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:32.125264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:32.126725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:32.134614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:32.135112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:32.135969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:32.136461 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:32.186426 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-823f1aaa-6264-41bd-8d30-8b52986a2f02 req-f6d9423e-65d3-4704-8b8c-468416fce48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "name": "network-vif-plugged", "status": "completed", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:32.194224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:32.194224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:32.203098 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-823f1aaa-6264-41bd-8d30-8b52986a2f02 req-f6d9423e-65d3-4704-8b8c-468416fce48a service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:32.203651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-823f1aaa-6264-41bd-8d30-8b52986a2f02 req-f6d9423e-65d3-4704-8b8c-468416fce48a service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:32.222435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-823f1aaa-6264-41bd-8d30-8b52986a2f02 req-f6d9423e-65d3-4704-8b8c-468416fce48a service nova] Creating event network-vif-plugged:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:52:32.227066 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-823f1aaa-6264-41bd-8d30-8b52986a2f02 req-f6d9423e-65d3-4704-8b8c-468416fce48a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053179 Nov 13 07:52:32.228062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 345/707] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:32.239286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:32.240074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:32.247685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:32.248144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:32.248930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:32.249374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:32.426787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:32.436043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1cf37963-0308-44d8-9a8e-6f7e9ac2495c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.320305 Nov 13 07:52:32.436762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 363/708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:32 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:32.490864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:32.503086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e77d64a5-20b8-4e33-a43a-4cbbf3ac37a1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.269875 Nov 13 07:52:32.512573 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 346/709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:32 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:33.466228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:33.466870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:33.475249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:33.475872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:33.476658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:33.477335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:33.527137 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:33.527817 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:33.536973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:33.537428 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:33.538219 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:33.538863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:33.777517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:33.788382 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d409ce1a-5c00-4fd3-beec-2f790fc1bd03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.338569 Nov 13 07:52:33.789198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 364/710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:33 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:33.822896 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:33.832224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d100cf37-41d9-42e9-afd4-434104b52679 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1358 microversion: 2.1 time: 0.316028 Nov 13 07:52:33.832848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 347/711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:33 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:34.038119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:34.038615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:34.046190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.046641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.047461 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.047897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.603846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-36a96a45-177f-46b3-b761-757018557f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments/4cd2510b-e136-4fdc-a8a3-04825d32689a" status: 202 len: 0 microversion: 2.1 time: 0.575571 Nov 13 07:52:34.604415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 365/712] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:52:34 2021] DELETE /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments/4cd2510b-e136-4fdc-a8a3-04825d32689a => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:52:34.618763 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:34.619680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:34.628021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.628471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.629376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.629691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.702917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bb1f57d4-6d3e-4e08-92af-73f5ddccf51f tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094084 Nov 13 07:52:34.703468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 348/713] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:34 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:34.812638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:34.813949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:34.821655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.822081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.822916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.823357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.862629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:34.863483 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:34.872263 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.872699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:34.873528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:34.873965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.042728 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:35.052756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fd9d3805-062c-41f4-95b7-a3ec531e12ae tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1271 microversion: 2.1 time: 0.249947 Nov 13 07:52:35.052756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 366/714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:34 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:35.098996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:35.107272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a9a7a65d-e8fa-43ef-ab97-d8d1062bb269 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1547 microversion: 2.1 time: 0.261246 Nov 13 07:52:35.112775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 349/715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:34 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1547 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:35.132811 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:35.133415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:35.140679 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.141125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.142074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.142512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.353733 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:35.362888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6fcfc40a-d876-4ed1-85b8-02cca722baa1 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1547 microversion: 2.1 time: 0.238980 Nov 13 07:52:35.363449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 367/716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:35 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:35.384306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:35.403419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:35.403419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:35.404656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:35.405337 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Searching by: {'deleted': False, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d'} {{(pid=97389) get_all /opt/stack/nova/nova/compute/api.py:2852}} Nov 13 07:52:35.413126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.413577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.414378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.415023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.511281 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.multi_cell_list [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=97389) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 13 07:52:35.604423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6d434782-ca49-4245-8bee-cfc7e8728f41 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.229575 Nov 13 07:52:35.605053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 350/717] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Nov 13 07:52:35 2021] GET /compute/v2.1/servers => generated 343 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:35.621077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:35.621802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:35.629167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.629668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.630442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.630918 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.721515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:35.722591 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:35.740110 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.740954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.741965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:35.742479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:35.815388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bbebb11c-2ea1-4661-8ff2-e80f32526ddb tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104541 Nov 13 07:52:35.816089 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 351/718] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:35 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:52:35.836181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:35.844111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ea8a4b41-5ba7-43de-9d99-5f30dec08864 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1547 microversion: 2.1 time: 0.232399 Nov 13 07:52:35.844658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 368/719] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:35 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1547 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:36.074339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:36.074980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:36.082737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:36.083132 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:36.083915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:36.084356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:36.291402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:36.300614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-79075994-b3cd-4cb5-9953-95d3589d9807 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.235477 Nov 13 07:52:36.301143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 352/720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:36 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:36.832614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:36.833617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:36.842250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:36.842643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:36.843483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:36.843919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:36.916369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b8962081-bf98-460d-b23e-82aa3dfc3522 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093294 Nov 13 07:52:36.916855 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 369/721] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:36 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:37.323229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:37.323830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:37.331714 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:37.337548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:37.337548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:37.337548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:37.538022 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:37.546134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0ed03608-fff6-4289-88af-6a09d6fea120 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.232193 Nov 13 07:52:37.546661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 353/722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:37 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:37.933547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:37.934439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:37.942216 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:37.942651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:37.943441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:37.943867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:38.012757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-17b30164-a972-4aa0-826a-40146ddf2951 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088507 Nov 13 07:52:38.013316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 370/723] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:37 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:38.422802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d9db4c5-acea-4912-9410-40153ac6dc19"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:38.423842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:38.431077 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:38.431523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:38.432294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:38.432722 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:38.577892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:38.578782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:38.592919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:38.593619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:38.594449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:38.594951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:38.808718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:38.816763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-42ee3a87-e8b0-4489-99fe-3cb7eefe9306 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.256469 Nov 13 07:52:38.817298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 371/724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:38 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:39.029703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:39.030612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:39.038206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:39.038651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:39.039465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:39.039877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:39.107892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b60122e4-d588-48cc-bf4a-f139b812b94c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087426 Nov 13 07:52:39.108443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 372/725] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:39 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:52:39.531597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ce19ddaa-08de-4d03-961d-cbd4fffb65f2 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.117800 Nov 13 07:52:39.532501 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 354/726] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:52:38 2021] POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments => generated 194 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:39.839155 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:39.839753 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:39.846866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:39.847307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:39.848067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:39.848495 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:40.054278 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:40.062355 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-be254417-6c01-4809-95e1-8ad233b98731 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.232326 Nov 13 07:52:40.063662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 373/727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:39 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:40.126233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:40.127297 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:40.136085 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:40.136530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:40.137293 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:40.137725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:40.208594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dabcea1f-a2b0-471f-a436-e41ea9a60c54 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092986 Nov 13 07:52:40.209136 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 355/728] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:40 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:41.084768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:41.085417 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:41.092593 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:41.093039 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:41.093820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:41.094257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:41.225556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:41.227106 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:41.234906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:41.239688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:41.239688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:41.239688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:41.303343 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:41.309373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-11fa61d4-687f-4986-b47e-40ae5d14085c tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093050 Nov 13 07:52:41.310148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 356/729] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:41 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:52:41.311409 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-88520daa-f505-4a47-8e56-aecc1d04a1b7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.236446 Nov 13 07:52:41.312065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 374/730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:41 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:42.326934 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:42.327844 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:42.333995 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:42.334596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:42.335845 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:42.336381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:42.337164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:42.337598 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:42.341608 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:42.342057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:42.342852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:42.343279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:42.407810 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-352194d3-f2d7-49b6-8787-9874a7ffa122 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090237 Nov 13 07:52:42.408653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 357/731] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:42 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:42.547710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:42.556268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a7c7d72e-ea17-40d1-bd23-33fd00b5b878 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.231980 Nov 13 07:52:42.557237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 375/732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:42 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:43.425070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:43.425990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:43.433226 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:43.433676 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:43.434444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:43.434952 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:43.506775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-063a12d2-061a-4a8f-a975-cdd371d6b143 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091981 Nov 13 07:52:43.507683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 358/733] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:43 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:43.580992 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:43.581698 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:43.589611 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:43.589611 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:43.590295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:43.590757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:43.804700 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:43.811891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-25daf2dd-3f67-4935-9371-31b1ca72faa1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.240294 Nov 13 07:52:43.812420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 376/734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:43 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:44.523623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:44.524585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:44.531871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:44.532319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:44.533121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:44.533720 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:44.613088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bd0ff517-4e69-45e9-bfbd-e0cab2e4123b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098765 Nov 13 07:52:44.614126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 359/735] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:44 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:44.834121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:44.835065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:44.842880 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:44.843336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:44.844107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:44.846479 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:45.052637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:45.060568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b0c34bac-ba2d-468e-9e0b-092877b4f6d1 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.235815 Nov 13 07:52:45.065931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 377/736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:44 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:45.630429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:45.631369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:45.638424 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:45.638906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:45.639680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:45.640118 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:45.707495 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3f86abf7-6d07-4d55-8d0a-98a4e777a8f7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086707 Nov 13 07:52:45.707966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 360/737] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:45 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:52:46.082876 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:46.083478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:46.090884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:46.091360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:46.092160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:46.092576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:46.292428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:46.300411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9ad32000-ac46-47fa-992e-e641e487478a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.227271 Nov 13 07:52:46.300874 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 378/738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:46 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:47.322227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:47.322862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:47.330461 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:47.330980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:47.331790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:47.332191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:47.530636 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:47.539240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7c19c11b-7b1e-4acc-803d-7d6973a41a19 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.226280 Nov 13 07:52:47.539773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 361/739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:47 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:48.561430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:48.562056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:48.570088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:48.570537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:48.571464 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:48.571896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:48.796158 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:48.805332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7b79aaf6-91dc-4756-94a8-f3b4d5b89534 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.253199 Nov 13 07:52:48.805988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 379/740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:48 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:49.531846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:49.532370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:49.539481 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:49.539921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:49.540679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:49.541112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:49.612310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:52:49.826565 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:49.827273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:49.834848 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:49.841617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:49.841617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:49.841617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.125199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:50.133337 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-37589d84-bf5d-4283-b238-0a99a64ae1fa tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.316044 Nov 13 07:52:50.133869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 380/741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:49 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:50.150081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fcadf635-4963-4f79-a090-16ffe964ee4e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 204 len: 0 microversion: 2.1 time: 0.627039 Nov 13 07:52:50.150351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:50.157756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:50.157886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 362/742] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:52:49 2021] DELETE /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 13 07:52:50.159027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.159751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.160616 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.161129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.171298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:50.171997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:50.180695 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.181413 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.182445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.183061 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.241410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6b64fd15-9f75-46ce-9ce0-4fbc987f07e6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments/39935685-1f9b-4d9e-abe5-890ed1e2ff09" status: 200 len: 194 microversion: 2.20 time: 0.101466 Nov 13 07:52:50.242209 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 381/743] 10.222.0.32 () {60 vars in 1453 bytes} [Sat Nov 13 07:52:50 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments/39935685-1f9b-4d9e-abe5-890ed1e2ff09 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:52:50.304244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-b4d9d664-80eb-45e8-915f-1c4c314a77b3 req-2cf2d704-0a61-491a-98f0-7a064911a60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "name": "network-vif-plugged", "status": "completed", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:50.310488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:50.310488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:52:50.319317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-b4d9d664-80eb-45e8-915f-1c4c314a77b3 req-2cf2d704-0a61-491a-98f0-7a064911a60b service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.319941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-b4d9d664-80eb-45e8-915f-1c4c314a77b3 req-2cf2d704-0a61-491a-98f0-7a064911a60b service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.345133 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-b4d9d664-80eb-45e8-915f-1c4c314a77b3 req-2cf2d704-0a61-491a-98f0-7a064911a60b service nova] Creating event network-vif-plugged:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:52:50.361200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-b4d9d664-80eb-45e8-915f-1c4c314a77b3 req-2cf2d704-0a61-491a-98f0-7a064911a60b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057718 Nov 13 07:52:50.361200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 382/744] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:50.370768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:50.371510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:50.379304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.379859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.380840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.381344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.443550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:50.455019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5a1a9de2-e9c4-435d-a33e-6f0160a1104e tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1513 microversion: 2.1 time: 0.294193 Nov 13 07:52:50.455828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 363/745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:50 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:50.822055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cf87f35e-3579-4a79-9d3c-270899122557 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments/39935685-1f9b-4d9e-abe5-890ed1e2ff09" status: 202 len: 0 microversion: 2.20 time: 0.462902 Nov 13 07:52:50.822622 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 383/746] 10.222.0.32 () {60 vars in 1456 bytes} [Sat Nov 13 07:52:50 2021] DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments/39935685-1f9b-4d9e-abe5-890ed1e2ff09 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:52:50.836507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:50.837464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:50.845251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.845700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.846473 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:50.846942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:50.914648 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a4fe2f4c-7dac-422f-b559-b9f255cee96c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087526 Nov 13 07:52:50.915146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 364/747] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:50 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:52:51.155352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:51.156051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:51.164344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.164841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:51.165567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.166002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:51.364418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:51.372401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ae35a3e6-1d23-4390-a675-42ecf1596dff tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.226838 Nov 13 07:52:51.372984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 384/748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:51 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:51.477800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:51.478403 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:51.485713 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.486157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:51.486952 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.487387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:51.690036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:51.698035 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2f7d3d22-1470-4b9c-a179-d12f34217f3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1513 microversion: 2.1 time: 0.229904 Nov 13 07:52:51.698559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 365/749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:51 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:51.931998 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:51.932986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:51.940841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.941233 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:51.942011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:51.942450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:52.013813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4e4d8645-0585-4252-bd1e-976bac71d0d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091550 Nov 13 07:52:52.014353 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 385/750] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:51 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:52:52.394140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:52.394769 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:52.401879 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:52.402332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:52.403113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:52.403563 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:52.606120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:52.615074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-807ee993-c09f-4882-ae29-868b65f5a446 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.229979 Nov 13 07:52:52.615543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 366/751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:52 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:52.721077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:52.721532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:52.730128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:52.730128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:52.731250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:52.732034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:52.939277 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:52.947427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ad3b39a8-a5b5-4974-96d9-e21b60f1f8de tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1513 microversion: 2.1 time: 0.236191 Nov 13 07:52:52.947984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 386/752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:52 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:53.031057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:53.031970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:53.039213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.039662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:53.040456 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.040875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:53.110151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-51cb89ed-d552-4d5b-beb4-9985b93e068b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088562 Nov 13 07:52:53.110738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 367/753] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:53 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:52:53.637287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:53.637892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:53.645021 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.645469 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:53.646246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.646715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:53.854147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:53.863095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-47d0f2fe-f14a-4248-aa80-30ad81dca65b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.235115 Nov 13 07:52:53.863617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 387/754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:53 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:53.968946 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:53.970067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:53.977197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.977644 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:53.978419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:53.978885 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:54.127793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:54.128487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:54.135839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:54.136489 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:54.137279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:54.137718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:54.183052 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:54.191307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fa511d89-dd05-42d5-a405-7881b337e9e8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1513 microversion: 2.1 time: 0.231417 Nov 13 07:52:54.191842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 368/755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:53 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:54.212387 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e5f47dd4-bb77-4361-bd68-8f26fa9ead00 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094286 Nov 13 07:52:54.213095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 388/756] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:54 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:52:54.885562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:54.886082 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:54.893153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:54.893600 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:54.894372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:54.894830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.112139 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:55.120315 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-46eb5ce3-9027-4d34-a5bf-5490ba132c06 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1259 microversion: 2.1 time: 0.244533 Nov 13 07:52:55.120860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 369/757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:54 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:55.214324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:55.214872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:55.222526 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.223192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.224142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.224725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.230520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:55.231496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:55.240166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.240776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.244622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.245128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.336349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3d75cae7-ab6a-4e34-9489-d072c556af95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115811 Nov 13 07:52:55.336929 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 370/758] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:55 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:52:55.437871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:55.445818 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b245708b-f7dc-4b41-8307-c803a8674746 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1513 microversion: 2.1 time: 0.240937 Nov 13 07:52:55.446576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 389/759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:55 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:55.940654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:55.941585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:55.948981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.949436 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:55.950227 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:55.950695 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.023872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4edd72f4-1bab-43d4-a552-499302270b9b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092816 Nov 13 07:52:56.024430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 371/760] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:52:55 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:52:56.139152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:56.139900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:56.145414 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:56.148370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:56.152624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.152624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.152624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.152624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.171454 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.174362 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.175609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.175898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.233924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Going to try to terminate instance {{(pid=97388) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:52:56.422043 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:56.437269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7a9fc8dc-0cd2-48fa-a1f9-ae5e7ce29819 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1443 microversion: 2.1 time: 0.303128 Nov 13 07:52:56.439802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 372/761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:56 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1443 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:56.451115 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:56.452117 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:56.463061 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.467418 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.467418 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.467418 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.622033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b97fba3f-4841-4dba-8b96-95cbbf0ddc10 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.182250 Nov 13 07:52:56.622033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 373/762] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:56 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:52:56.633174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:56.633795 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:56.641464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.641872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.642730 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.643174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.679297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-23f65010-ff1d-4d88-bf4b-8f66cb5b1e1f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 204 len: 0 microversion: 2.1 time: 0.549761 Nov 13 07:52:56.683735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 390/763] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:52:56 2021] DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:52:56.703032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:56.709548 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:56.722182 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.722785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:56.729388 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:56.730283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.068951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:57.077748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d57b34fe-4823-47f3-87b3-d71c9085820a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1443 microversion: 2.1 time: 0.454773 Nov 13 07:52:57.078995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 374/764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:56 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1443 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:57.089800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-10b35b18-b8da-49aa-b777-18f83d37da04 req-92d54faa-326d-4136-8d56-962b0743287f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64f7c47-8d0f-436b-a8f1-0d0a76416ca8", "name": "network-vif-deleted", "tag": "842792f1-dadf-4dda-9cd0-832261f0bb2d"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:52:57.097840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:52:57.097840 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:52:57.107052 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-10b35b18-b8da-49aa-b777-18f83d37da04 req-92d54faa-326d-4136-8d56-962b0743287f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.107532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-10b35b18-b8da-49aa-b777-18f83d37da04 req-92d54faa-326d-4136-8d56-962b0743287f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.126876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-10b35b18-b8da-49aa-b777-18f83d37da04 req-92d54faa-326d-4136-8d56-962b0743287f service nova] Creating event network-vif-deleted:842792f1-dadf-4dda-9cd0-832261f0bb2d for instance e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 on hv-cinder-81783 Nov 13 07:52:57.131238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:57.131918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-10b35b18-b8da-49aa-b777-18f83d37da04 req-92d54faa-326d-4136-8d56-962b0743287f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050772 Nov 13 07:52:57.132977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 375/765] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:52:57.141272 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0c66f1ef-191a-471b-90d0-6412a8e8b66d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 200 len: 1471 microversion: 2.1 time: 0.459213 Nov 13 07:52:57.143002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 391/766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:56 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:57.153296 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:57.153967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:57.155595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:57.157026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:57.163198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.163651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.164439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.167620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.168331 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.169121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.169533 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.170791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.514781 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:57.527692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dcbd0b9d-d8f5-47f5-a131-fa4f23913a3f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1675 microversion: 2.1 time: 0.393365 Nov 13 07:52:57.528242 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 376/767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:57 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1675 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:57.639298 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:57.640270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:57.648417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.648868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.649655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.650091 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.725202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cd979477-439a-4368-87e1-2ab1deccae0d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095552 Nov 13 07:52:57.729955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 377/768] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:57 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:52:57.741283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:57.741796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:57.749311 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.749880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.751990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:57.751990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:57.814496 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:57.832300 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ec569df6-2fda-4955-9b26-93fffff20fec tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1593 microversion: 2.1 time: 0.688246 Nov 13 07:52:57.832869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 392/769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:57 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1593 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:58.164996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:58.166267 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: e64f7c47-8d0f-436b-a8f1-0d0a76416ca8] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:58.175825 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.176707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.177696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.178957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.233415 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Instance e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 could not be found. Nov 13 07:52:58.233929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 404 to user: Instance e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:52:58.235065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b04563ec-a2bd-43c9-a15b-2c664b5255c8 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8" status: 404 len: 111 microversion: 2.1 time: 0.080514 Nov 13 07:52:58.235617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 393/770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:58 2021] GET /compute/v2.1/servers/e64f7c47-8d0f-436b-a8f1-0d0a76416ca8 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:52:58.415109 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-728da5e9-1102-4fcd-9408-770f85a03070 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "DELETE /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4/os-volume_attachments/40d34cf8-14b7-4be9-9ad7-2f3e021d6d0d" status: 202 len: 0 microversion: 2.1 time: 0.684228 Nov 13 07:52:58.415728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 378/771] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:52:57 2021] DELETE /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4/os-volume_attachments/40d34cf8-14b7-4be9-9ad7-2f3e021d6d0d => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:52:58.558886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:58.558886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:58.567931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.568580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.569531 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.570121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.748255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:58.749229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:58.790569 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.792218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.797452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:58.797452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:58.899969 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0f75d6a6-6176-40b8-a3c5-0d65b98ca32f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.166726 Nov 13 07:52:58.900756 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 379/772] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:52:58 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:52:59.012472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:59.012964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:59.023993 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:52:59.027831 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.028450 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.029617 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.029755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.037125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a40a9dc2-71bd-4e77-8e5e-349371f9f23c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1675 microversion: 2.1 time: 0.495601 Nov 13 07:52:59.038713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 394/773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:52:58 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1675 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:52:59.122830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:52:59.778584 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-caf5f9e7-7b5b-401c-8eba-1d9f755bbb83 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 204 len: 0 microversion: 2.20 time: 0.775581 Nov 13 07:52:59.779597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 380/774] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Nov 13 07:52:59 2021] DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 13 07:52:59.800688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:59.800688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:59.809073 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.809922 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.810904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.811499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.851291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:52:59.851890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:52:59.869547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.870003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.870833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:52:59.871281 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:52:59.962019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:53:00.390063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-edc90875-f3a1-4d6b-a05f-cc991dcd94f6 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 204 len: 0 microversion: 2.1 time: 0.555609 Nov 13 07:53:00.392646 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 381/775] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:52:59 2021] DELETE /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 13 07:53:00.415835 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:00.423631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:00.432947 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.433753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:00.434648 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.435356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:00.750260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:00.767104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:00.777119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:00.778279 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6f806a55-d16f-45d8-b5d7-5de9e5b3403f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 0.993428 Nov 13 07:53:00.779478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 395/776] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:52:59 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:00.793845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:00.794894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:00.806828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.808059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:00.809056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.809495 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:00.957472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:00.967140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-57ee7516-8d73-4acd-918a-2b987b0d9339 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1675 microversion: 2.1 time: 0.569402 Nov 13 07:53:00.968694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 382/777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:00 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1675 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:00.979202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:00.979735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:00.988327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.988775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:00.989559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:00.989990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:01.088405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:53:01.516619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:01.528246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-400ed207-68f2-4e59-a617-8c59353771c3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1514 microversion: 2.1 time: 0.747694 Nov 13 07:53:01.530091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 396/778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:00 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1514 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:01.640267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-84c04959-5db7-4308-a1f5-7e96a9af531d tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "DELETE /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 204 len: 0 microversion: 2.1 time: 0.670265 Nov 13 07:53:01.641155 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 383/779] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:53:00 2021] DELETE /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:53:01.660723 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:01.661625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:01.673687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:01.674072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:01.679906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:01.680546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:01.804876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-dfb6cd64-8bdb-4825-a403-e72469dcf4c7 req-de3f8250-cfc5-434a-ac3f-8b36cda99651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:01.822709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:01.822709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:01.848280 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-dfb6cd64-8bdb-4825-a403-e72469dcf4c7 req-de3f8250-cfc5-434a-ac3f-8b36cda99651 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:01.848726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-dfb6cd64-8bdb-4825-a403-e72469dcf4c7 req-de3f8250-cfc5-434a-ac3f-8b36cda99651 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:01.890749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-dfb6cd64-8bdb-4825-a403-e72469dcf4c7 req-de3f8250-cfc5-434a-ac3f-8b36cda99651 service nova] Creating event network-changed:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:53:01.902816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-dfb6cd64-8bdb-4825-a403-e72469dcf4c7 req-de3f8250-cfc5-434a-ac3f-8b36cda99651 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103883 Nov 13 07:53:01.903758 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 384/780] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:01.925261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:01.925901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:01.947493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:01.947951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:01.948750 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:01.949180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:02.805337 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:02.819320 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dfefe986-a3fe-4c20-91c9-7451d2c93eab tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1512 microversion: 2.1 time: 1.173514 Nov 13 07:53:02.822498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 397/781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:01 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1512 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:02.844951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:02.845929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:02.867487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:02.868240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:02.869300 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:02.870004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:02.912788 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:02.939294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:02.958332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:02.959507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-29e8a9e0-3bed-4c35-96ff-e516b13215fc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1723 microversion: 2.20 time: 1.054621 Nov 13 07:53:02.970972 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 385/782] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:01 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1723 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:02.988766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:02.989382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:03.005670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:03.006117 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:03.006927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:03.007361 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:03.155360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:03.190788 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-712f5b06-af1e-4ce2-b6ad-b34949150fb2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1607 microversion: 2.1 time: 0.353964 Nov 13 07:53:03.200172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 398/783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:02 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1607 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:03.855339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:03.855906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:03.875389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:03.876168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:03.877269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:03.881380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:04.705494 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:04.724454 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b7e3f208-a912-44e9-96b5-9e5799adf018 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1512 microversion: 2.1 time: 0.888335 Nov 13 07:53:04.729129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 399/784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:03 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1512 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:04.749297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:04.757734 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:04.777100 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:04.780157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:04.781104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:04.781660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:04.986238 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:05.013689 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-de925655-06b6-4bf5-95b2-b05b16df98a0 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1514 microversion: 2.1 time: 2.045431 Nov 13 07:53:05.014553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 386/785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:02 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1514 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:05.029641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:05.030777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:05.049435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.050416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:05.055746 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.057322 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:05.112959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:05.140989 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:05.151631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:05.152787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0dedad10-a083-4c18-99c9-99408bf75f1a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1655 microversion: 2.20 time: 0.424499 Nov 13 07:53:05.153307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 400/786] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:04 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1655 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:05.187691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ddafd433-c680-4151-ab77-0d6bb951f2ef req-ba304e15-1fbd-4eb4-b294-d529b476acb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6", "name": "network-vif-deleted", "tag": "05dbf5a8-522c-40dd-8370-3137b750dcd6"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:05.207634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:05.207634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:05.216261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ddafd433-c680-4151-ab77-0d6bb951f2ef req-ba304e15-1fbd-4eb4-b294-d529b476acb4 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.216963 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ddafd433-c680-4151-ab77-0d6bb951f2ef req-ba304e15-1fbd-4eb4-b294-d529b476acb4 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:05.233976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ddafd433-c680-4151-ab77-0d6bb951f2ef req-ba304e15-1fbd-4eb4-b294-d529b476acb4 service nova] Creating event network-vif-deleted:05dbf5a8-522c-40dd-8370-3137b750dcd6 for instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 on hv-cinder-81783 Nov 13 07:53:05.240189 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ddafd433-c680-4151-ab77-0d6bb951f2ef req-ba304e15-1fbd-4eb4-b294-d529b476acb4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080085 Nov 13 07:53:05.241015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 401/787] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:05.562790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:05.605791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-8e2dc13a-08dd-455b-94ec-8a0a59f6dbcd req-61997814-0804-46f1-a981-53416a99a42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae6ec323-dff8-4169-9a56-94903662c347", "name": "network-vif-deleted", "tag": "acac643d-73db-44ba-af16-2880e5385d21"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:05.633818 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dc9a6ab0-50f1-4858-a123-71e73a72ba56 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 200 len: 1322 microversion: 2.1 time: 0.617869 Nov 13 07:53:05.637656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 387/788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:05 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:05.642175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:05.642175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:05.666778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-8e2dc13a-08dd-455b-94ec-8a0a59f6dbcd req-61997814-0804-46f1-a981-53416a99a42f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.667568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-8e2dc13a-08dd-455b-94ec-8a0a59f6dbcd req-61997814-0804-46f1-a981-53416a99a42f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:05.684465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-8e2dc13a-08dd-455b-94ec-8a0a59f6dbcd req-61997814-0804-46f1-a981-53416a99a42f service nova] Creating event network-vif-deleted:acac643d-73db-44ba-af16-2880e5385d21 for instance ae6ec323-dff8-4169-9a56-94903662c347 on hv-cinder-81783 Nov 13 07:53:05.691796 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-8e2dc13a-08dd-455b-94ec-8a0a59f6dbcd req-61997814-0804-46f1-a981-53416a99a42f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165306 Nov 13 07:53:05.693144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 402/789] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:05.760459 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:05.765404 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:05.793748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.795924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:05.795924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:05.795924 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.041721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:06.045976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:06.084966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.087150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.088624 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.091336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.258970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.260223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.260855 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid ae6ec323-dff8-4169-9a56-94903662c347 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:06.380059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:06.402646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dca64e1c-ad31-48d1-a42e-4595006dc91d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 200 len: 1308 microversion: 2.1 time: 0.372726 Nov 13 07:53:06.403239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 403/790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:06 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:06.425838 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:06.433582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:06.450721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.452406 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.458427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.459145 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.639696 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:06.673200 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8cfecd07-f454-48b5-89ee-07b811c96a7c tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1512 microversion: 2.1 time: 0.930398 Nov 13 07:53:06.677167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 388/791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:05 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1512 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:06.704663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:06.710515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:06.741907 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.742508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.743426 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:06.751667 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:06.832333 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:06.851358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. Nov 13 07:53:06.852710 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:06.853696 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a9f1c4df-abe7-430e-8f7a-3d35f8a6de16 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 404 len: 111 microversion: 2.1 time: 0.175312 Nov 13 07:53:06.854422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 389/792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:06 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:53:06.871608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f9b66771-d844-49e1-b53c-ed16bf33fcfa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '.version_select at 0x7f54ef83ae50>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:06.881838 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:06.893965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:06.895153 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0c259011-5b36-4783-83d3-00fc89f0ee77 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 200 len: 1655 microversion: 2.20 time: 0.489778 Nov 13 07:53:06.895675 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 404/793] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:06 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 1655 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:06.996875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f9b66771-d844-49e1-b53c-ed16bf33fcfa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279721466" status: 202 len: 0 microversion: 2.1 time: 0.137429 Nov 13 07:53:06.998309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 390/794] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Nov 13 07:53:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279721466 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:53:07.277135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-7462a76b-a4fd-4b65-859b-94ac9089a4fc req-880e3cca-1a37-4db6-ad0f-65942fe8227c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:07.292604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:07.292604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:07.311776 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-7462a76b-a4fd-4b65-859b-94ac9089a4fc req-880e3cca-1a37-4db6-ad0f-65942fe8227c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.314013 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-7462a76b-a4fd-4b65-859b-94ac9089a4fc req-880e3cca-1a37-4db6-ad0f-65942fe8227c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.347014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-7462a76b-a4fd-4b65-859b-94ac9089a4fc req-880e3cca-1a37-4db6-ad0f-65942fe8227c service nova] Creating event network-changed:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:53:07.355592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-7462a76b-a4fd-4b65-859b-94ac9089a4fc req-880e3cca-1a37-4db6-ad0f-65942fe8227c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089682 Nov 13 07:53:07.363103 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 405/795] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:07.429231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:07.430177 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: ae6ec323-dff8-4169-9a56-94903662c347] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:07.442332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.443348 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.444709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.445367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.547102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Instance ae6ec323-dff8-4169-9a56-94903662c347 could not be found. Nov 13 07:53:07.549638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 404 to user: Instance ae6ec323-dff8-4169-9a56-94903662c347 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:07.550706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4a8cac8c-b4fa-4a83-9e68-ae703becf0ad tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347" status: 404 len: 111 microversion: 2.1 time: 0.134431 Nov 13 07:53:07.561040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 391/796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:07 2021] GET /compute/v2.1/servers/ae6ec323-dff8-4169-9a56-94903662c347 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:53:07.582259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:07.582954 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:07.633232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.634222 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.635368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.638947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.699677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:07.699677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:07.708910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.709958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.711150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.711815 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.789318 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Going to try to terminate instance {{(pid=97388) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:53:07.808906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:07.809595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:07.810251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lazy-loading 'fault' on Instance uuid 39ac6e01-c355-4ef0-bc3a-efbff58658c4 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:08.285534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '457263d3a89f452bb9faeb4becd60a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1157f51a4ae044748780b6818d3bef86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:08.304592 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c0401b87-ca1c-4e47-95e2-49cd9dd6ff27 tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 200 len: 1308 microversion: 2.1 time: 0.615601 Nov 13 07:53:08.315226 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 392/797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:07 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:08.336601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:08.337412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:08.353686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:08.354140 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:08.354973 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:08.355408 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:08.367222 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0e93fdfe-40c5-40df-b9f4-440e07de4562 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 204 len: 0 microversion: 2.1 time: 0.802148 Nov 13 07:53:08.368377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 406/798] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:53:07 2021] DELETE /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:53:08.397445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10558cad-5f50-40b7-b4e0-367f83693f74", "name": "network-vif-deleted", "tag": "1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8"}, {"server_uuid": "39ac6e01-c355-4ef0-bc3a-efbff58658c4", "name": "network-vif-deleted", "tag": "ff95e79a-d2c3-4508-a5d2-1a99bf8900f7"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:08.424933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:08.424933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:08.446765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:08.449235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:08.481619 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. Nov 13 07:53:08.482735 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:08.483760 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5bd11e0d-d900-4116-80e8-e9ab1a945e4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 404 len: 111 microversion: 2.20 time: 0.167455 Nov 13 07:53:08.489191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 393/799] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:08 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 13 07:53:08.498349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] Creating event network-vif-deleted:1da27f12-ecce-4c5a-ac3b-0ad69ec47ee8 for instance 10558cad-5f50-40b7-b4e0-367f83693f74 on hv-cinder-81783 Nov 13 07:53:08.498895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] Creating event network-vif-deleted:ff95e79a-d2c3-4508-a5d2-1a99bf8900f7 for instance 39ac6e01-c355-4ef0-bc3a-efbff58658c4 on hv-cinder-81783 Nov 13 07:53:08.507378 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:08.508188 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:08.516759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:08.517419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:08.518447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:08.519392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:08.537028 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-1a4db632-9f9a-4f77-90a7-0ae6ac874f2f req-35cfed57-0423-4223-b805-8a7460148573 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.166366 Nov 13 07:53:08.537961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 407/800] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:08 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:08.550507 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-495140a2-26d9-481c-9922-2d86642733e7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '.version_select at 0x7f54efd6c670>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:08.698173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-495140a2-26d9-481c-9922-2d86642733e7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064463901" status: 204 len: 0 microversion: 2.20 time: 0.158904 Nov 13 07:53:08.699182 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 408/801] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Nov 13 07:53:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064463901 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 13 07:53:09.184128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:09.199228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: .version_select at 0x7f54efd26430>, body: {"keypair": {"name": "tempest-keypair-1392057867"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:09.199385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae34c287-1edf-483e-9456-5a90b6a2fb2a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1514 microversion: 2.1 time: 0.706935 Nov 13 07:53:09.199385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 394/802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:08 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1514 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:09.235887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:09.239996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:09.328356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:09.328967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] [instance: 39ac6e01-c355-4ef0-bc3a-efbff58658c4] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:09.336701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:09.337154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:09.337965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:09.338402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:09.390367 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] HTTP exception thrown: Instance 39ac6e01-c355-4ef0-bc3a-efbff58658c4 could not be found. Nov 13 07:53:09.390956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] Returning 404 to user: Instance 39ac6e01-c355-4ef0-bc3a-efbff58658c4 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:09.391777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a625a6b7-4c68-4a0e-aeae-2ca2d414f59a tempest-VolumesSnapshotTestJSON-1667934722 tempest-VolumesSnapshotTestJSON-1667934722-project] 10.222.0.32 "GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4" status: 404 len: 111 microversion: 2.1 time: 0.072997 Nov 13 07:53:09.396196 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 395/803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:09 2021] GET /compute/v2.1/servers/39ac6e01-c355-4ef0-bc3a-efbff58658c4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:53:09.889418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:09.893441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:09.906466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-65f04783-9a92-448b-a310-f67d0e6084cf tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.738080 Nov 13 07:53:09.907179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 409/804] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Nov 13 07:53:09 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:10.221265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:10.222530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:10.230288 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:10.230760 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:10.231535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:10.231963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:10.586137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: .version_select at 0x7f54efd4ca60>, body: {"keypair": {"name": "tempest-keypair-1300207155"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:10.651914 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:10.662014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:10.927502 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:10.932219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:10.946977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a9843d5-c9c5-4a8a-8c8c-15d3545ddddb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.370059 Nov 13 07:53:10.947565 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 410/805] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Nov 13 07:53:10 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 13 07:53:11.111962 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:11.120643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-398b7ae7-cb82-4b9d-ac22-16ac94737314 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1514 microversion: 2.1 time: 0.909056 Nov 13 07:53:11.121278 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 396/806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:10 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1514 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:11.449454 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ac11d2aa-4a32-4445-ae3f-9c61e0183743 req-2dc3bd1f-69b2-438b-90a8-cffe7925c133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ca8361-d649-4c86-9bb0-3dd0bd8b241d", "name": "network-vif-deleted", "tag": "8307707c-10a8-4d30-9b1c-b1f8a02ce5af"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:11.456128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:11.456128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:11.466443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ac11d2aa-4a32-4445-ae3f-9c61e0183743 req-2dc3bd1f-69b2-438b-90a8-cffe7925c133 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:11.467164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ac11d2aa-4a32-4445-ae3f-9c61e0183743 req-2dc3bd1f-69b2-438b-90a8-cffe7925c133 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:11.487354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ac11d2aa-4a32-4445-ae3f-9c61e0183743 req-2dc3bd1f-69b2-438b-90a8-cffe7925c133 service nova] Creating event network-vif-deleted:8307707c-10a8-4d30-9b1c-b1f8a02ce5af for instance f5ca8361-d649-4c86-9bb0-3dd0bd8b241d on hv-cinder-81783 Nov 13 07:53:11.492380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ac11d2aa-4a32-4445-ae3f-9c61e0183743 req-2dc3bd1f-69b2-438b-90a8-cffe7925c133 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052607 Nov 13 07:53:11.493054 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 411/807] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:11.945121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-507530238"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:11.945723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:11.953593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:11.954047 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:11.955507 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:11.955948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:12.143398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:12.144862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:12.152575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:12.153273 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:12.154241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:12.154872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:12.190457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.network.security_group_api [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Adding security group 008ed6ca-1746-405a-ab4c-d1129a682e7e to port cb05581f-0d6b-4d29-a731-d459dd0f8143 Nov 13 07:53:12.252487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:12.253528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:12.253999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid f5ca8361-d649-4c86-9bb0-3dd0bd8b241d {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:12.325178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:12.333823 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b5d295c5-2ddb-4065-8464-691dad3461b7 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1308 microversion: 2.1 time: 0.200014 Nov 13 07:53:12.334452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 412/808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:12 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:12.795947 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-645a68f9-1d43-42af-a59b-dc682ea2bc6c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.860615 Nov 13 07:53:12.796899 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 397/809] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:11 2021] POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:53:12.815445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:12.816278 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:12.843200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:12.843658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:12.844445 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:12.844870 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:13.356216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:13.356784 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:13.364168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:13.364609 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:13.365387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:13.365816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:13.437870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:13.438436 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:13.438791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid f5ca8361-d649-4c86-9bb0-3dd0bd8b241d {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:13.504091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:13.518618 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-094d9b1a-10c9-4680-a571-2a01477b705a tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1758 microversion: 2.1 time: 0.717035 Nov 13 07:53:13.527019 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 413/810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:12 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1758 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:13.538994 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-b2890ba5-b74a-442a-b0e9-a671d4568d6f req-33baf915-e995-49fb-9d34-c8458bbe8e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:13.546432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:13.546432 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:53:13.555790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-b2890ba5-b74a-442a-b0e9-a671d4568d6f req-33baf915-e995-49fb-9d34-c8458bbe8e76 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:13.556323 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-b2890ba5-b74a-442a-b0e9-a671d4568d6f req-33baf915-e995-49fb-9d34-c8458bbe8e76 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:13.573148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-b2890ba5-b74a-442a-b0e9-a671d4568d6f req-33baf915-e995-49fb-9d34-c8458bbe8e76 service nova] Creating event network-changed:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:53:13.580853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-b2890ba5-b74a-442a-b0e9-a671d4568d6f req-33baf915-e995-49fb-9d34-c8458bbe8e76 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050159 Nov 13 07:53:13.583793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 414/811] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:13.586724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:13.595015 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-306d9341-4ac9-47f0-b1ac-1e4e96f3d19a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1308 microversion: 2.1 time: 0.248149 Nov 13 07:53:13.595864 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 398/812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:13 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:14.335745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-119566797", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ce4da95-76b6-4434-b98c-5899f375e796"}], "security_groups": [{"name": "tempest-securitygroup--771040585"}], "key_name": "tempest-keypair-1392057867", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:14.617677 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:14.618299 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:14.626126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:14.627155 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:14.627983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:14.628423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:14.630476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] validate_networks() for [('5ce4da95-76b6-4434-b98c-5899f375e796', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:53:14.710337 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:14.711213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:14.711839 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid f5ca8361-d649-4c86-9bb0-3dd0bd8b241d {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:14.788693 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:14.797490 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f0860a67-c976-4513-87c2-2b8b56515c75 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 200 len: 1308 microversion: 2.1 time: 0.190018 Nov 13 07:53:14.798648 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 399/813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:14 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:15.265150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-672679643", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68227660-1969-4380-bdbb-e55ad209027e"}], "security_groups": [{"name": "tempest-securitygroup--103453243"}], "key_name": "tempest-keypair-1300207155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:15.391538 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] validate_networks() for [('68227660-1969-4380-bdbb-e55ad209027e', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:53:15.496242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:53:15.496779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:53:15.497536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:53:15.497968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:53:15.498376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:53:15.507685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:15.508122 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:15.508915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:15.509342 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:15.529791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for project 728dba4850df46759bff46353cf16a60. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:15.533801 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Getting quotas for user 7ef6287046b64615abf251066d342bfd and project 728dba4850df46759bff46353cf16a60. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:15.544475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:53:15.546892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:53:15.704459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-330c5daf-f87d-43a0-b365-4f6fb974d889 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.378297 Nov 13 07:53:15.707459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 415/814] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:53:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:53:15.722889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bd8594fa-90cb-41ad-94c3-aa1f546824c7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:15.724009 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bd8594fa-90cb-41ad-94c3-aa1f546824c7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:15.812266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bd8594fa-90cb-41ad-94c3-aa1f546824c7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:15.825380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bd8594fa-90cb-41ad-94c3-aa1f546824c7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1237 microversion: 2.1 time: 0.108510 Nov 13 07:53:15.825380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 416/815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:15 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:15.838348 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:15.838988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: f5ca8361-d649-4c86-9bb0-3dd0bd8b241d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:15.846742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:15.847185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:15.848043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:15.848471 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:15.900199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Instance f5ca8361-d649-4c86-9bb0-3dd0bd8b241d could not be found. Nov 13 07:53:15.900759 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 404 to user: Instance f5ca8361-d649-4c86-9bb0-3dd0bd8b241d could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:15.901575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bf0cf406-c334-480e-8496-3ac67037c3ac tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d" status: 404 len: 111 microversion: 2.1 time: 0.078828 Nov 13 07:53:15.905912 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 417/816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:15 2021] GET /compute/v2.1/servers/f5ca8361-d649-4c86-9bb0-3dd0bd8b241d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:53:16.248907 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:53:16.249418 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:53:16.249834 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:53:16.250247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:53:16.250664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:53:16.259511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:16.259988 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:16.261269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:16.261269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:16.278643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for project f490cae0b0bc42e9967df5c301d2299b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:53:16.282554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Getting quotas for user b66c11f533f645e7b610164a5168c34e and project f490cae0b0bc42e9967df5c301d2299b. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:53:16.293072 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:53:16.295363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:53:16.419725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-971ee7e2-46c8-4e77-a4b5-00995b8a8416 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.164461 Nov 13 07:53:16.420341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 400/817] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Nov 13 07:53:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 13 07:53:16.437288 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:16.437948 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:16.519831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:16.539819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:16.549233 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:16.550592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-214dd2cc-0603-4485-aeb6-4710a40a77f3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1281 microversion: 2.20 time: 0.123610 Nov 13 07:53:16.551587 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 418/818] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:16 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:16.845863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:16.845863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:16.853381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:16.854017 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:16.854992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:16.855584 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:16.978181 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:16.986453 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-937556b7-c603-43df-a631-1d963a7dc471 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1241 microversion: 2.1 time: 0.151416 Nov 13 07:53:16.987019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 401/819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:16 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:17.713731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:17.714341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:17.722766 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:17.723438 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:17.724228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:17.724671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:17.848879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:17.863366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:17.869650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:17.870739 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-873d8a40-5220-4987-8a9a-24c24dbe8687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1285 microversion: 2.20 time: 0.305074 Nov 13 07:53:17.871460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 419/820] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:17 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:18.009262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:18.010587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:18.018466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:18.019212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:18.020195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:18.020823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:18.153314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:18.162342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-141978af-cf8e-4b8b-9632-bc4d775da257 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1241 microversion: 2.1 time: 0.162788 Nov 13 07:53:18.163091 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 402/821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:17 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:18.893280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:18.893837 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:18.901375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:18.901814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:18.902583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:18.903050 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:19.024443 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:19.037910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:19.044303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:19.045374 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e0bd1f8e-f63f-433e-ac27-717ba2dcea66 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1277 microversion: 2.20 time: 0.161535 Nov 13 07:53:19.046637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 420/822] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:18 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:19.184575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:19.185193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:19.193387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:19.194036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:19.194859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:19.195460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:19.318798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:19.326868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c4c524bc-817a-4d84-99a4-4da8c05c80f8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1289 microversion: 2.1 time: 0.151803 Nov 13 07:53:19.327437 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 403/823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:19 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:20.070068 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:20.070664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:20.077747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:20.078210 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:20.079001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:20.080067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:20.201280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:20.215221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:20.221420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:20.222462 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-33dcdbf8-e7b0-47c9-b42b-6518d8ab6a4d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1277 microversion: 2.20 time: 0.162084 Nov 13 07:53:20.223005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 421/824] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:20 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:20.425160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:20.425778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:20.432904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:20.433358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:20.434135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:20.434571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:20.577216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:20.585479 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c74626ee-6f6f-407e-9686-62aea2188eb3 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1289 microversion: 2.1 time: 0.244690 Nov 13 07:53:20.586195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 404/825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:20 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1289 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:21.245721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:21.246329 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:21.254833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:21.255601 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:21.256464 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:21.256973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:21.463669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:21.478724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:21.487089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:21.488597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fc480d4b-ce5f-40f8-9f9e-213cc2fbb101 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1277 microversion: 2.20 time: 0.252381 Nov 13 07:53:21.489113 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 422/826] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:21 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:21.614622 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:21.615341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:21.622862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:21.623623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:21.624591 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:21.625032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:21.817998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:21.825954 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-45afe7eb-6011-4cda-8f86-005648743b39 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1307 microversion: 2.1 time: 0.227084 Nov 13 07:53:21.827986 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 405/827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:21 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:22.520512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:22.521529 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:22.529172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.529863 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:22.530778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.531452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:22.659968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:22.673858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:22.683056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:22.684190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1229e35f-dbfd-4029-bd18-6633a882ea08 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1351 microversion: 2.20 time: 0.179629 Nov 13 07:53:22.695890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 423/828] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:22 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1351 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:22.787351 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:22.787857 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:22.795034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.795560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:22.796637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.797075 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:22.855390 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:22.857799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:22.871328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.872841 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:53:22.875778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:22.879862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:22.880393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:23.157268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:23.178470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d627e8fb-415b-4d35-b4bd-381be7cadbb7 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.324952 Nov 13 07:53:23.178470 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 424/829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:22 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:23.290286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e625b615-8dcb-404f-afc1-d9dd89713a3b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 204 len: 0 microversion: 2.1 time: 0.512679 Nov 13 07:53:23.299323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 406/830] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:53:22 2021] DELETE /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 13 07:53:23.310336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:23.311046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:23.319243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:23.319701 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:23.320497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:23.320930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:23.546425 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:23.558114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2c83486f-07b1-41e4-bf6a-4738baa0fe2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1513 microversion: 2.1 time: 0.255100 Nov 13 07:53:23.558114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 425/831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:23 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:23.711589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:23.712392 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:23.720541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:23.720984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:23.721766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:23.722194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:24.196320 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:24.196988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:24.204792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:24.205242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:24.206056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:24.206493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:24.424779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:24.432712 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-694dc336-dea5-4ca9-862a-19ac7eeb2694 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.248208 Nov 13 07:53:24.433482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 426/832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:24 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:24.486741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:24.500748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:24.507330 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:24.508544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-47c24b3a-5dac-4b13-8f03-e73428ca3256 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.809184 Nov 13 07:53:24.509149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 407/833] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:23 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:24.584780 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:24.587196 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:24.596830 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:24.597558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:24.598438 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:24.599007 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:24.831044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:24.839375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-704ffbf7-29bb-4761-8f42-1a912b8bf1a2 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1513 microversion: 2.1 time: 0.269218 Nov 13 07:53:24.839911 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 427/834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:24 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:25.456708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:25.458356 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:25.474090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.476192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.480510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.480961 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.572645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-0fb9303b-feb1-4a5f-b4c8-334bc10d6b53 req-3244d4c3-87ae-442f-b811-ae55557de8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53c3e0f-d326-43f9-bfff-2072456b8c6e", "tag": "0af3e445-8a61-4c2b-8348-8d66fb50e3a6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:25.593443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:25.593443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:25.611126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-0fb9303b-feb1-4a5f-b4c8-334bc10d6b53 req-3244d4c3-87ae-442f-b811-ae55557de8b1 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.611561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-0fb9303b-feb1-4a5f-b4c8-334bc10d6b53 req-3244d4c3-87ae-442f-b811-ae55557de8b1 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.640977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-0fb9303b-feb1-4a5f-b4c8-334bc10d6b53 req-3244d4c3-87ae-442f-b811-ae55557de8b1 service nova] Creating event network-changed:0af3e445-8a61-4c2b-8348-8d66fb50e3a6 for instance b53c3e0f-d326-43f9-bfff-2072456b8c6e on hv-cinder-81783 Nov 13 07:53:25.649076 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-0fb9303b-feb1-4a5f-b4c8-334bc10d6b53 req-3244d4c3-87ae-442f-b811-ae55557de8b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214871 Nov 13 07:53:25.649076 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 408/835] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:25.671679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:25.680937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:25.694283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.697553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.698640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.699354 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.821000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:25.829033 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c0ae5edf-b6d6-4b9a-8acd-e1e2b84ab6bc tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.382857 Nov 13 07:53:25.829594 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 428/836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:25 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:25.866855 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:25.867610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:25.874863 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.875327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:25.876144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:25.877086 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:26.095591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:26.105420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-42f3f55a-d4ea-4659-a713-aea28e390676 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1513 microversion: 2.1 time: 0.252016 Nov 13 07:53:26.106607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 429/837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:25 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:26.598232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:26.612725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:26.619074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:26.620136 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e0f454f1-34bc-4cdd-af36-6f0264d5b029 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.958304 Nov 13 07:53:26.620657 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 409/838] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:25 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:26.862069 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:26.862703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:26.872616 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:26.872972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:26.873968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:26.874973 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.122641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.128092 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:27.131406 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4693eb14-6fe5-41f1-b673-6be2c2f427f2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.285263 Nov 13 07:53:27.132101 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 430/839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:26 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:27.141372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:27.151909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.152475 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.153410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.153851 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.171248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:27.172784 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:27.183088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.183685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.184588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.185034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.420123 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.428433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-74841188-d882-42c6-9215-3c66c46a6f7a tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1471 microversion: 2.1 time: 0.309701 Nov 13 07:53:27.428974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 410/840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:27 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:27.500258 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-63c06a59-bacc-46a5-b304-8e089ae71f04 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.341196 Nov 13 07:53:27.501779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 431/841] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:27 2021] POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:53:27.515566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:27.516434 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:27.524490 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.524944 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.525741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.526178 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.645346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:27.645650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:27.652958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.653449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.654221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.654653 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.742812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.755329 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e757d0e2-8d7b-42b1-af4c-1dc083a204d6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.249123 Nov 13 07:53:27.765197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 411/842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:27 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:27.776314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}, {"server_uuid": "fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9", "name": "network-vif-deleted", "tag": "74c33848-80cd-4dad-9e44-62fc6557bdbc"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:27.783510 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:27.783510 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:27.792978 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:27.793423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:27.810964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] Creating event network-changed:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:53:27.811464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] Creating event network-vif-deleted:74c33848-80cd-4dad-9e44-62fc6557bdbc for instance fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 on hv-cinder-81783 Nov 13 07:53:27.818778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-7bd2041b-2d52-46c0-b00f-8ef6673fd54f req-e1ffef51-c501-4c11-a4db-dddad8d53c22 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051654 Nov 13 07:53:27.819610 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 412/843] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:27 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:27.884022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.897580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.903709 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:27.904755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-36564424-d7fa-470c-9a75-84c9d503799c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.270251 Nov 13 07:53:27.905324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 432/844] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:27 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:53:28.154519 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:28.155154 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:28.162607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.163086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.163859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.164291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.452411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:28.453013 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:28.460239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.460683 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.461460 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.461885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.565167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:28.573164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5129c798-66f4-454b-97fc-a7830c0a408a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.428311 Nov 13 07:53:28.573690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 413/845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:28 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:28.594129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:28.602824 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ecf98251-6a65-4477-8c3b-7a9a1d817660 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1471 microversion: 2.1 time: 0.161437 Nov 13 07:53:28.604544 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 433/846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:28 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:28.778315 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:28.778940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:28.786880 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.787324 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.788080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.788509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.928274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:28.928902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:28.936293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.936865 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.937651 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:28.938087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:28.992970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.002171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-79b60ab6-cedc-484b-ab24-eae8c14cfbc0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.232853 Nov 13 07:53:29.002724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 414/847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:28 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:29.142800 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.156564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.162958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.164143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-69b31ff5-15d0-4568-9a9a-54c343baba97 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.244959 Nov 13 07:53:29.164564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 434/848] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:28 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:53:29.595974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:29.596580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:29.603866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:29.604315 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:29.605093 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:29.605523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:29.625646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:29.626867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:29.633972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:29.634418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:29.635236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:29.635668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:29.757924 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.766091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-20d8670f-72ca-45a0-9903-eb3457db67e3 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1471 microversion: 2.1 time: 0.149604 Nov 13 07:53:29.766644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 435/849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:29 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:29.820543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:29.828842 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4cf583e0-ec9b-4507-8ef5-c6dee5421f02 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.242189 Nov 13 07:53:29.829400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 415/850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:29 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:30.024398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:30.025000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:30.032060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.032995 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.033757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.034188 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.188744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:30.194179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:30.197079 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.197531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.198305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.198761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.251366 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:30.271059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-756be019-828c-4dfd-9808-c036e231efdc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.255655 Nov 13 07:53:30.272696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 436/851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:30 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:30.779310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:30.788304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:30.788979 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:30.793097 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:30.796390 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.796930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.798353 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.798908 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.800126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:30.801199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-19bb5df8-f007-4408-980b-c86bdb1e814d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.622042 Nov 13 07:53:30.801726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 416/852] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:30 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:53:30.850990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:30.852292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:30.859834 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.860787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.861627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.862050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.874890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:30.875404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:30.876483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:30.942414 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:30.950570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7deddedb-8791-4dc0-b798-6a5f6d9c7f2d tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1308 microversion: 2.1 time: 0.172021 Nov 13 07:53:30.951126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 437/853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:30 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:31.075330 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:31.083875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-001ba895-b930-4877-a3a1-2e8072477077 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.242416 Nov 13 07:53:31.084411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 417/854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:30 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:31.294912 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:31.295421 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:31.302477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.306444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:31.306444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.306444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:31.512457 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:31.521644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-04d64322-a64e-4962-b3ce-4d5a2f91d519 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.236056 Nov 13 07:53:31.522422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 438/855] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:31 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:31.825301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:31.825908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:31.835951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.835951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:31.835951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.835951 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:31.973383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:31.974074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:31.981730 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.982421 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:31.983442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:31.984063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.057884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.063359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:32.063812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.064262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:32.071971 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.078625 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.079771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8a6c3b47-ff34-43c6-a4bd-b10d38a983f1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.263699 Nov 13 07:53:32.080319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 418/856] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:31 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:32.127627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:32.127627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:32.127627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:32.127627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.129153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:32.129153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.129439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.135737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c04c48aa-d829-421f-8772-55e8bcd3acfc tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1308 microversion: 2.1 time: 0.172299 Nov 13 07:53:32.136287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 439/857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:31 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:32.326848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.335305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8e286a3e-7024-423f-aa32-c15e0dcfb037 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.237998 Nov 13 07:53:32.335832 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 419/858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:32 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:32.543925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:32.544525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:32.552282 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:32.552725 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.553485 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:32.553910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:32.756693 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:32.765107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-de8d04d6-b2cf-4fe3-b8bd-ea43605c1021 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.230413 Nov 13 07:53:32.765627 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 440/859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:32 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:33.104150 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:33.104748 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:33.112160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.112601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.113368 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.113797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.158303 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:33.158935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:33.166049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.166504 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.167310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.167740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.245860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.246218 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.246661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lazy-loading 'fault' on Instance uuid fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:53:33.308499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0728501bcf8493a8704d5ca9f4dadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0c482ef1eb4f8fa6c1320897c1678b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:33.316605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0af44df8-a233-444d-afbf-137592ff0916 tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 200 len: 1308 microversion: 2.1 time: 0.168168 Nov 13 07:53:33.317137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 441/860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:33 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:33.326744 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:33.341069 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:33.348029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:33.349080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8c3ad709-a6ad-45e6-b46c-ac9aa68ca711 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.254564 Nov 13 07:53:33.349594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 420/861] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:33 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:33.357413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:33.358114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:33.365666 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.366114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.367102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.367552 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.589941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:33.598447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ac83d33b-db97-4ecd-b262-56fe9bfa6cb8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.250362 Nov 13 07:53:33.599019 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 442/862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:33 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:33.786958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:33.787480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:33.795018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.795476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:33.796272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:33.796712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.335990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:34.338342 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:34.339331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] [instance: fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:34.346152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c3bbf313-cba7-4c1d-b3a0-5c1ba4790c51 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.568594 Nov 13 07:53:34.346965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 421/863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:33 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:34.347500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.347957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.348742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.349180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.375129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:34.376010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:34.384854 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.385544 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.392595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.393607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.402428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] HTTP exception thrown: Instance fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 could not be found. Nov 13 07:53:34.403055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] Returning 404 to user: Instance fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:53:34.404162 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0254a416-8bae-41fb-bc32-bec33fbd6d9b tempest-AttachVolumeNegativeTest-660132647 tempest-AttachVolumeNegativeTest-660132647-project] 10.222.0.32 "GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9" status: 404 len: 111 microversion: 2.1 time: 0.075582 Nov 13 07:53:34.404886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 443/864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:34 2021] GET /compute/v2.1/servers/fc046a65-12ec-4bf8-8fe6-c9f3a29bddf9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:53:34.622558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:34.623907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:34.632790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.640985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.640985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:34.640985 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:34.872327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:34.881877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-02ae08ed-3e3d-442e-9406-5953e6994e8a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.269354 Nov 13 07:53:34.882426 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 444/865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:34 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:35.204565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:35.253734 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:35.289890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:35.293531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-46de35f8-2fb4-4a14-a771-6ef1739f9c23 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.929116 Nov 13 07:53:35.314003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 422/866] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:34 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:35.372819 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:35.375105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:35.390082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:35.390541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:35.391400 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:35.391883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:35.659323 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:35.672005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0467e017-3a98-4471-bf83-3e52460bbe1c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1750 microversion: 2.1 time: 0.312060 Nov 13 07:53:35.673828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 445/867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:35 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1750 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:35.903989 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:35.904520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:35.911805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:35.912384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:35.913084 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:35.913523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:36.137533 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:36.149762 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-01cef0ee-b753-4cf9-98be-e4630a965f45 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.254725 Nov 13 07:53:36.160026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 423/868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:35 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:36.320636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:36.321509 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:36.329291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:36.330101 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:36.331125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:36.331772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:36.554923 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:36.569879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:36.576346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:36.577389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4dcd2dfd-4cf5-4351-8694-e0f871240fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.266931 Nov 13 07:53:36.578230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 446/869] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:36 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:36.694574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:36.698281 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:36.702332 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:36.702816 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:36.703590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:36.704054 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:36.932355 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:36.944814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-07676dee-635b-42f4-b08b-214c91d626e4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.256197 Nov 13 07:53:36.944814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 424/870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:36 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:37.172007 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:37.174647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:37.180718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.181483 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:37.182943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.183680 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:37.398087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:37.407631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4c85050d-d7c3-4659-99bd-325b584badd6 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.244361 Nov 13 07:53:37.413342 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 447/871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:37 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:37.601856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:37.602461 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:37.610785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.617078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:37.617078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.617078 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:37.888725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:37.905660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:37.914273 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:37.915370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2eeb03c9-4804-43e8-8745-97779e9edf49 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.323056 Nov 13 07:53:37.916662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 425/872] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:37 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:37.966301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:37.967089 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:37.974718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.975181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:37.975965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:37.976400 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:38.267592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:38.276740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5610dc7d-6ebb-4934-ba0e-67ecfd5882af tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.320803 Nov 13 07:53:38.277264 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 448/873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:37 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:38.293916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-dc085602-3c05-4693-a288-c4285f845626 req-8284368e-f11e-4fb8-ba14-a50afb4cd7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53c3e0f-d326-43f9-bfff-2072456b8c6e", "name": "network-vif-plugged", "status": "completed", "tag": "0af3e445-8a61-4c2b-8348-8d66fb50e3a6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:38.301919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:38.301919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:38.312146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-dc085602-3c05-4693-a288-c4285f845626 req-8284368e-f11e-4fb8-ba14-a50afb4cd7e3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:38.312598 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-dc085602-3c05-4693-a288-c4285f845626 req-8284368e-f11e-4fb8-ba14-a50afb4cd7e3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:38.329245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-dc085602-3c05-4693-a288-c4285f845626 req-8284368e-f11e-4fb8-ba14-a50afb4cd7e3 service nova] Creating event network-vif-plugged:0af3e445-8a61-4c2b-8348-8d66fb50e3a6 for instance b53c3e0f-d326-43f9-bfff-2072456b8c6e on hv-cinder-81783 Nov 13 07:53:38.334208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-dc085602-3c05-4693-a288-c4285f845626 req-8284368e-f11e-4fb8-ba14-a50afb4cd7e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244990 Nov 13 07:53:38.334838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 426/874] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:38.430928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:38.434907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:38.439487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:38.439951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:38.440783 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:38.441216 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:38.676630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:38.685173 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-234d80ca-def9-449f-95f0-21a95b070dcb tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.264145 Nov 13 07:53:38.685698 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 449/875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:38 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:38.940023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:38.940708 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:38.947967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:38.948411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:38.949187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:38.949615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:39.156184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:39.171496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:39.177938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:39.178876 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ce870f18-6e5f-4bff-b140-a0ce17ae29c5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.249291 Nov 13 07:53:39.179402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 427/876] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:38 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:39.300327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:39.300947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:39.308148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:39.308599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:39.309386 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:39.309820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:39.520043 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:39.528721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-231f20ae-c12a-4eab-9140-a6760815373d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.238356 Nov 13 07:53:39.529240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 450/877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:39 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:39.710573 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:39.711483 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:39.718957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:39.719429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:39.720208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:39.720640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:39.990383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:40.002381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6259a1b3-f17d-4d3f-99e2-143822880d22 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1362 microversion: 2.1 time: 0.301003 Nov 13 07:53:40.002381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 428/878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:39 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:40.202768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:40.203378 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:40.210962 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:40.211412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:40.212200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:40.212619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:40.358122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-1ff7437c-74b3-42f6-99c8-138b39591789 req-d840201b-9c21-4446-8182-8fb9a1881ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "name": "network-vif-plugged", "status": "completed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:40.365628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:40.365628 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:40.373884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-1ff7437c-74b3-42f6-99c8-138b39591789 req-d840201b-9c21-4446-8182-8fb9a1881ab4 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:40.374560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-1ff7437c-74b3-42f6-99c8-138b39591789 req-d840201b-9c21-4446-8182-8fb9a1881ab4 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:40.393174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-1ff7437c-74b3-42f6-99c8-138b39591789 req-d840201b-9c21-4446-8182-8fb9a1881ab4 service nova] Creating event network-vif-plugged:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:53:40.397958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-1ff7437c-74b3-42f6-99c8-138b39591789 req-d840201b-9c21-4446-8182-8fb9a1881ab4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048909 Nov 13 07:53:40.398447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 429/879] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:53:40.504896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:40.518480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:40.524927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:40.526558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0d9642f1-25cd-4102-b9d8-947274638e6e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.333497 Nov 13 07:53:40.527324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 451/880] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:40 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:40.555128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:40.556435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:40.564846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:40.565624 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:40.566557 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:40.567230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:40.789832 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:40.798932 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0f962f40-cf7a-4bf6-8566-6193060c6973 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.256077 Nov 13 07:53:40.799467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 430/881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:40 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:41.022654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:41.024707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:41.030411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.030902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.031687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.032157 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.334969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:41.344593 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7e104a64-4a1f-4532-9c9e-6cba3aecd90f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1549 microversion: 2.1 time: 0.332036 Nov 13 07:53:41.345339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 452/882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:41 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1549 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:41.369441 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:41.369943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:41.380388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.380738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.381898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.382501 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.560700 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:41.575847 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:41.587403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.590587 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.592201 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0ad20a9f-ac62-4ca3-b619-17a9ad2e0f5a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235124 Nov 13 07:53:41.593026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 431/883] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Nov 13 07:53:41 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:41.595427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.595988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.823702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:41.824708 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:41.834802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.840663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.840663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:41.840663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:41.936386 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:41.972148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:41.993184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:41.995906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-909a40af-705c-4e5a-86fd-51fe6ddbcaf0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1406 microversion: 2.20 time: 0.454572 Nov 13 07:53:42.007799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 453/884] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:41 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:42.454260 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:42.467271 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e77e6cc8-eb64-4e28-acec-46485480cf44 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.654796 Nov 13 07:53:42.469624 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 432/885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:41 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:43.021793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:43.022530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:43.030138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.030585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.031466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.031897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.260735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:43.274497 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:43.281006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:43.282646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dffb857e-b526-48ed-8f04-4b501bc8b3e2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1595 microversion: 2.20 time: 0.272977 Nov 13 07:53:43.283186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 454/886] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:53:43 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1595 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:53:43.310524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:43.311305 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:43.319146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.319687 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.320547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.321104 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.493996 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:43.495112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:43.504396 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.505077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.506081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.506912 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.541976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-de7bd141-4eda-4da8-b78c-d4db17ffb03c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.243365 Nov 13 07:53:43.544262 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 433/887] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Nov 13 07:53:43 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:53:43.931164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:43.932191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:43.941811 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.943300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:43.944325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:43.944985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:44.066884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-024aad84-edcc-4ee4-8048-54767b0b1626 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 0.144587 Nov 13 07:53:44.067680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 434/888] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:43 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:53:44.096212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-657ca2b4-fbef-4e62-837e-4e4830f723f8 req-0aff6d56-6eb5-4cc0-a080-62402243a72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53c3e0f-d326-43f9-bfff-2072456b8c6e", "tag": "0af3e445-8a61-4c2b-8348-8d66fb50e3a6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:44.097926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:44.114987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:44.114987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:44.118999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9ee18cc3-836f-469c-b4b7-c007efd89ab3 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.637149 Nov 13 07:53:44.129713 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 455/889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:43 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:44.152272 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-657ca2b4-fbef-4e62-837e-4e4830f723f8 req-0aff6d56-6eb5-4cc0-a080-62402243a72d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:44.159148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-657ca2b4-fbef-4e62-837e-4e4830f723f8 req-0aff6d56-6eb5-4cc0-a080-62402243a72d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:44.194413 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-657ca2b4-fbef-4e62-837e-4e4830f723f8 req-0aff6d56-6eb5-4cc0-a080-62402243a72d service nova] Creating event network-changed:0af3e445-8a61-4c2b-8348-8d66fb50e3a6 for instance b53c3e0f-d326-43f9-bfff-2072456b8c6e on hv-cinder-81783 Nov 13 07:53:44.206439 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-657ca2b4-fbef-4e62-837e-4e4830f723f8 req-0aff6d56-6eb5-4cc0-a080-62402243a72d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136921 Nov 13 07:53:44.207754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 435/890] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:45.090226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:45.091561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:45.113716 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.114384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:45.115011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.115450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:45.150928 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:45.151547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:45.167107 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.175433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:45.176786 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.177409 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:45.311719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6269205b-96f7-4375-abbf-cb0f7baf87f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 0.237741 Nov 13 07:53:45.316010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 456/891] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:45 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:53:45.516270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:45.527364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-589f9874-2ff8-41e4-a559-a81278640743 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.394108 Nov 13 07:53:45.527918 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 436/892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:45 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:45.899846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:45.900983 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:45.918737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.919240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:45.920217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:45.920664 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:46.043093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cbadbe21-1e85-4d84-8120-2445e38dc8e0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 14 microversion: 2.20 time: 0.156038 Nov 13 07:53:46.044376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 457/893] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:45 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:46.282008 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-20a7afcf-0417-466c-98eb-6c26c043038b req-79238642-da50-444d-9b51-68ccb26513f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:46.288318 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:53:46.288318 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:53:46.297886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-20a7afcf-0417-466c-98eb-6c26c043038b req-79238642-da50-444d-9b51-68ccb26513f3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:46.298339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-20a7afcf-0417-466c-98eb-6c26c043038b req-79238642-da50-444d-9b51-68ccb26513f3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:46.322083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-20a7afcf-0417-466c-98eb-6c26c043038b req-79238642-da50-444d-9b51-68ccb26513f3 service nova] Creating event network-changed:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:53:46.327520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-20a7afcf-0417-466c-98eb-6c26c043038b req-79238642-da50-444d-9b51-68ccb26513f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438590 Nov 13 07:53:46.328643 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 437/894] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:53:46.332009 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:46.333665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:46.345131 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:46.346836 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:46.347023 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:46.347477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:46.467814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-85df0c3b-43ed-4306-84dd-c0dda06453b2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 0.148367 Nov 13 07:53:46.468551 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 458/895] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:46 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:53:46.556152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:46.557676 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:46.571614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:46.572364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:46.573906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:46.574549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:47.063388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:47.073332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:47.074346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:47.081602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a598363a-99e9-4e55-a075-5ab29ee8c441 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.540420 Nov 13 07:53:47.087245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 438/896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:46 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:47.098180 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:47.098628 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:47.099658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:47.099943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:47.236036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8c43d532-2566-4c8f-9073-2f92d6754bde tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 14 microversion: 2.20 time: 0.182202 Nov 13 07:53:47.238913 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 459/897] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:47 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:47.485282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:47.485817 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:47.495391 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:47.496314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:47.498020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:47.498948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:47.631777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-252dc868-4c49-4561-baff-09bbe6329fd9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 0.145891 Nov 13 07:53:47.631777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 439/898] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:47 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:53:48.110324 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:48.111124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:48.123669 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.124114 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:48.125130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.125557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:48.256466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:48.257602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:48.266836 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.267329 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:48.268306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.268907 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:48.361928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:48.370625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b0212d05-1fd6-4736-b42c-bf42ea511650 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.270519 Nov 13 07:53:48.371190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 460/899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:48 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:48.637957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:48.639106 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:48.647724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.648174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:48.648976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:48.649418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:51.079921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-606b61b2-b669-4d5f-be2d-fea21be16239 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 14 microversion: 2.20 time: 2.834764 Nov 13 07:53:51.080543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 440/900] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:48 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 14 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:51.089703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-316eff68-2b6c-41fd-a133-1bdfc2a42507 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 2.460663 Nov 13 07:53:51.091383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:51.091806 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 461/901] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:48 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:53:51.092090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:51.099995 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:51.100438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:51.101297 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:51.101736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:51.312002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:51.321547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7a9c1eba-5308-4ff9-a23a-8354bd67538d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.239747 Nov 13 07:53:51.322099 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 441/902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:51 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:52.111500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:52.112712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:52.113633 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:52.119466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:52.128010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.128701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.129653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.130260 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.131225 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.131683 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.132476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.132913 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.248490 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-188f4a51-8f01-4ba1-98ac-77a711effa9c tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 0.150907 Nov 13 07:53:52.250472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 442/903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:52 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:53:52.274864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-57973a1e-beb1-4cad-b3b8-088eb1ae652b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 14 microversion: 2.20 time: 0.187092 Nov 13 07:53:52.275719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 462/904] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:52 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:52.346581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:52.347830 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:52.358326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.358938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.360369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:52.360812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:52.588152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:52.596641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5dbcecbc-01e1-4a8f-88b3-61b4013f00c4 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.260182 Nov 13 07:53:52.597360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 443/905] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:52 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:53.267487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:53.268499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:53.276484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:53.276933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:53.277748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:53.278187 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:53.291464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:53.292381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:53.299498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:53.299948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:53.300852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:53.301286 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:56.073249 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3c00acbc-68ed-429e-9424-ac23a03a4c92 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 14 microversion: 2.1 time: 2.815858 Nov 13 07:53:56.073921 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 463/906] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:53 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 14 bytes in 2818 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:53:56.079491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c93c0cb4-5695-4219-ab29-3ce68ded30fb tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 14 microversion: 2.20 time: 2.797053 Nov 13 07:53:56.081255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 444/907] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:53 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 14 bytes in 2799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:53:56.084480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:56.085171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:56.092935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:56.093380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:56.094711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:56.095148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:56.303482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:56.312269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f1ad6a54-6401-4a93-89e6-6752df19a98b tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.237220 Nov 13 07:53:56.312778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 464/908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:56 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:53:57.092021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:57.092021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:57.097683 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:53:57.098852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:57.100742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:57.101190 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:57.101977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:57.102410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:57.112934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:57.113389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:57.114191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:57.114632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:59.555010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-46a366c8-9846-46c5-8e19-84bab52c9a2f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 12758 microversion: 2.1 time: 2.473720 Nov 13 07:53:59.558630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 445/909] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:53:57 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 12758 bytes in 2476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:53:59.569371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:53:59.569905 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a2cbd7e6-1a94-4038-bd09-ffa6777b9bf2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 13967 microversion: 2.20 time: 2.481368 Nov 13 07:53:59.570382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:53:59.578874 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:59.579216 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 465/910] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:53:57 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 13967 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:53:59.583269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:59.583269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:53:59.583269 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:53:59.790783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:53:59.799403 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-84e1e9be-ae68-49f1-ae77-1fe7bc06d0ad tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.242131 Nov 13 07:53:59.799934 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 446/911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:53:59 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:00.571812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:00.572802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:00.580909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:00.581358 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:00.582129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:00.582558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:00.587686 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:00.588673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:00.597784 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:00.598327 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:00.599209 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:00.599711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:02.764317 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-24ae9dd7-deca-444d-8b38-66c935413aaa tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 20173 microversion: 2.1 time: 2.201888 Nov 13 07:54:02.764954 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 466/912] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:00 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 20173 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:02.775939 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:02.776635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:02.779578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a38f464a-719f-4b6e-890d-da196ee45d0e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 21288 microversion: 2.20 time: 2.201813 Nov 13 07:54:02.781059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 447/913] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:00 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 21288 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:02.784540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:02.785032 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:02.785810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:02.786245 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:03.003607 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:03.012175 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2582f83e-c044-4f3d-880c-2e31e42f0fdf tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1755 microversion: 2.1 time: 0.245561 Nov 13 07:54:03.012697 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 467/914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:02 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:03.783425 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:03.784611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:03.792786 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:03.793229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:03.793999 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:03.794427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:03.808171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:03.809290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:03.818351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:03.818842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:03.819629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:03.820131 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:03.917844 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-25fd2d80-ffc6-43fc-9d7d-53cdd476f5af tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 22121 microversion: 2.1 time: 0.144607 Nov 13 07:54:03.918653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 448/915] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:03 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 22121 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:03.947265 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-7a570bee-0ab4-4cbe-87f1-bc738ac447f8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 22765 microversion: 2.20 time: 0.159723 Nov 13 07:54:03.950714 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 468/916] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:03 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 22765 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:04.035360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:04.036636 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:04.043833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.044281 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:04.045063 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.045495 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:04.265649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:04.273670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-90951a82-fa85-4205-8256-02acd7ad393d tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1758 microversion: 2.1 time: 0.247857 Nov 13 07:54:04.274202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 449/917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:04 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:04.935846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:04.936834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:04.944958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.945403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:04.946159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.946589 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:04.965725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:04.966640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:04.973701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.974153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:04.974959 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:04.975398 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:07.964987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-956dcffc-9aa3-4592-85dd-1ec2415cd5bd tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 26357 microversion: 2.20 time: 3.008320 Nov 13 07:54:07.965716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 450/918] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:04 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 26357 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:07.979566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-15c938f9-8891-4e0e-9c43-f87f08fea225 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 26485 microversion: 2.1 time: 3.053119 Nov 13 07:54:07.980293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 469/919] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:04 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 26485 bytes in 3055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:08.983187 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:08.985037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:08.992814 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:08.993261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:08.994038 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:08.994474 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:09.003559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:09.004552 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:09.012193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:09.012635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:09.013389 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:09.013814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:11.437556 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f58a1b4e-4c2d-4972-9235-a37566c5cfae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 27723 microversion: 2.1 time: 2.442981 Nov 13 07:54:11.438270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 470/920] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:08 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 27723 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:54:11.454300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-85616131-6e2d-4bb7-ae05-c10f77644e98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 27834 microversion: 2.20 time: 2.480523 Nov 13 07:54:11.454956 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 451/921] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:08 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 27834 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:12.457160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:12.458168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:12.466403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:12.466890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:12.467670 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:12.468110 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:12.471463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:12.472630 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:12.480659 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:12.481047 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:12.481833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:12.482309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:12.592569 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3502a67c-6099-4b0a-95cc-d340a004da7e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28149 microversion: 2.1 time: 0.145903 Nov 13 07:54:12.593782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 471/922] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:12 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28149 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:12.624180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b58554d5-f31a-4ce7-9622-57d492304a57 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28196 microversion: 2.20 time: 0.162145 Nov 13 07:54:12.624921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 452/923] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:12 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28196 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:13.612501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:13.613558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:13.623693 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:13.624689 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:13.625467 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:13.625895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:13.646127 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:13.647878 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:13.657565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:13.658255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:13.659548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:13.660142 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:13.775557 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-37c016e7-3fc6-4d3c-b356-718a8eb5f313 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28196 microversion: 2.20 time: 0.139412 Nov 13 07:54:13.776394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 453/924] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:13 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28196 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:13.900207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-69bf5abb-6921-4154-b354-687dc924bdae tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28149 microversion: 2.1 time: 0.298547 Nov 13 07:54:13.900765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 472/925] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:13 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28149 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:14.793882 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:14.794828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:14.803228 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:14.803678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:14.804445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:14.804886 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:14.917722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:14.918747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:14.927179 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:14.927630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:14.928402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:14.928834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:17.561847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-90605e09-80f7-4822-bb3f-b2440ab52049 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28196 microversion: 2.20 time: 2.777480 Nov 13 07:54:17.565911 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 454/926] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:14 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28196 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:17.573016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-99191c93-2d89-4e42-9408-4780c41f36e1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28149 microversion: 2.1 time: 2.664622 Nov 13 07:54:17.576820 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 473/927] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:14 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28149 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:54:18.580128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:18.581129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:18.589611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:18.589611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:18.590810 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:18.590927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:18.595294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:18.595418 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:18.600634 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:18.601079 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:18.601854 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:18.602280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:20.972891 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c993b49c-43fd-4991-b8a9-e74dc7b7b68f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28485 microversion: 2.20 time: 2.402839 Nov 13 07:54:20.976701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 455/928] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:18 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28485 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:20.984302 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-04844f11-ec8b-4059-b021-84712d88c3c5 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28438 microversion: 2.1 time: 2.403357 Nov 13 07:54:20.985538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 474/929] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:18 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28438 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:54:21.993067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:21.994071 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:22.001938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:22.002290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:22.002745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:22.003274 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:22.003394 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:22.003606 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:22.011263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:22.011695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:22.012465 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:22.012891 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:22.129816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-aaae2944-1ac2-49d7-8d0f-a5679ea8e08e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28438 microversion: 2.1 time: 0.137011 Nov 13 07:54:22.133829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 475/930] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:21 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:54:22.146721 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d1d94aef-c778-47f3-9967-d6a7b61999aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28485 microversion: 2.20 time: 0.163312 Nov 13 07:54:22.147559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 456/931] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:21 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:23.151004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:23.151636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:23.160758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:23.161236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:23.162065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:23.162724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:23.165517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:23.166601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:23.175652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:23.176141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:23.176915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:23.177344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:26.121488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a481a3c8-f915-4626-a750-de4ccaee8d9e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 2.982227 Nov 13 07:54:26.122378 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 476/932] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:23 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 2984 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:26.137608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5cfa96a2-48e6-4050-9805-d3460da85f59 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 2.982961 Nov 13 07:54:26.138243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 457/933] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:23 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:27.140758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:27.148402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:27.149286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:27.149737 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:27.150512 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:27.150972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:27.158515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:27.159621 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:27.167866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:27.168282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:27.169131 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:27.169646 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:27.256972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-372ffd3d-2446-42c9-859b-708e66b6bff9 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 0.126968 Nov 13 07:54:27.260969 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 477/934] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:27 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:27.276603 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5391390c-9bd7-45f3-aaa9-8e03a21b1fda tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 0.130596 Nov 13 07:54:27.277578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 458/935] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:27 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:28.274792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:28.275782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:28.284087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:28.284532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:28.285297 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:28.285732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:28.295402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:28.296394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:28.305151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:28.305603 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:28.306584 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:28.307141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:28.400930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-090752ae-fce8-461b-90bd-1302810ed106 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 0.135596 Nov 13 07:54:28.402262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 478/936] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:28 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:28.559794 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-93404c40-e19b-483e-97a0-f4a1848c0882 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 0.274635 Nov 13 07:54:28.561308 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 459/937] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:28 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:29.419584 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:29.420503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:29.428592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:29.429037 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:29.429802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:29.430386 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:29.578690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:29.579691 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:29.587495 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:29.587942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:29.588711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:29.589174 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:31.609076 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-40a69619-82a7-4079-872d-e497e6a2baa8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 2.199020 Nov 13 07:54:31.610458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 479/938] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:29 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:31.612971 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-34060d27-b548-42b5-905e-83920d695482 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 2.044143 Nov 13 07:54:31.614010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 460/939] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:29 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:32.628229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:32.629234 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:32.630511 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:32.631543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:32.637148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:32.637598 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:32.638369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:32.638830 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:32.639352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:32.639808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:32.640596 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:32.641034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:32.752467 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-09670548-ce07-4643-9b0c-1a08544c6980 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 0.134360 Nov 13 07:54:32.753186 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 480/940] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:32 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:32.757743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2fa6319c-1515-4726-9b41-caea154e5376 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 0.137399 Nov 13 07:54:32.758370 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 461/941] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:32 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:33.770899 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:33.771893 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:33.775759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:33.776753 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:33.779831 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:33.780271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:33.781049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:33.781477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:33.784652 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:33.785103 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:33.785884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:33.786312 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:33.897807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ce244123-1548-45dd-af9a-6fc3c8422fd2 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 28606 microversion: 2.1 time: 0.136912 Nov 13 07:54:33.902134 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 481/942] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:33 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 28606 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:33.906979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2f353c08-747b-40fc-b11e-7c93b9fa48c9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 28653 microversion: 2.20 time: 0.137328 Nov 13 07:54:33.906979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 462/943] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:33 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 28653 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:34.916124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:34.917168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:34.923361 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:34.924366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:34.925119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:34.925570 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:34.926341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:34.926791 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:34.932326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:34.932779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:34.933607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:34.934048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:35.057750 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2a8e9fa8-3688-491d-ab0d-63b007d76c0e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 29731 microversion: 2.1 time: 0.151608 Nov 13 07:54:35.058405 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 482/944] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:34 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 29731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:35.074151 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f114d68f-aadf-4dbd-b5a0-f7405b1f7f8b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 29845 microversion: 2.20 time: 0.162145 Nov 13 07:54:35.075543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 463/945] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:34 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 29845 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:36.075410 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:36.076384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:36.084670 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:36.085119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:36.085892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:36.086328 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:36.091547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:36.092559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:36.101003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:36.101458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:36.102240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:36.102755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:36.209630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fe1f480c-b646-46b1-8ae1-5eaca3e80ce1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 31630 microversion: 2.1 time: 0.143649 Nov 13 07:54:36.210291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 483/946] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:36 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 31630 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:36.250567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6cc23640-5f27-4f51-b32b-2df71c945bb9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 31600 microversion: 2.20 time: 0.168687 Nov 13 07:54:36.254089 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 464/947] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:36 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 31600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:37.227299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:37.228354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:37.236566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:37.236988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:37.237787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:37.238219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:37.268784 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:37.269941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:37.277996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:37.278524 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:37.279432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:37.279935 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:37.352600 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-17516fcc-fb48-4063-b6e2-fa53cda0b236 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 32763 microversion: 2.1 time: 0.134798 Nov 13 07:54:37.353235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 484/948] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:37 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 32763 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:37.398859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9aaa3c40-83cf-463f-815e-f4b9347b4ab4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 32968 microversion: 2.20 time: 0.140300 Nov 13 07:54:37.399594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 465/949] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:37 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 32968 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:38.369899 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:38.370943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:38.378400 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:38.378889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:38.379655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:38.380085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:38.417743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:38.418879 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:38.430855 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:38.432170 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:38.433372 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:38.433812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:38.496095 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a34a8e3e-b77b-4acb-8ed6-c4a67dc17dee tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 33620 microversion: 2.1 time: 0.135648 Nov 13 07:54:38.497128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 485/950] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:38 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 33620 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:38.558321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-befc1cb6-b88c-4084-85d3-f10eaed3d087 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 33887 microversion: 2.20 time: 0.149634 Nov 13 07:54:38.560234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 466/951] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:38 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 33887 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:39.514354 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:39.516052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:39.524142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:39.524605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:39.525380 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:39.525812 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:39.585322 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:39.586983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:39.595396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:39.596581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:39.597463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:39.597915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:39.644335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d4abd876-59a9-476a-9a2c-d85227b8664d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 34549 microversion: 2.1 time: 0.139314 Nov 13 07:54:39.645981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 486/952] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:39 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 34549 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:39.723762 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-819592a8-7022-4e70-b9c8-9566bc9e2aaa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 34905 microversion: 2.20 time: 0.156105 Nov 13 07:54:39.724777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 467/953] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:39 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 34905 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:40.662136 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:40.663162 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:40.670950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:40.671959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:40.673124 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:40.673228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:40.742195 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:40.743900 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:40.752352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:40.752807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:40.753598 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:40.754037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:40.794682 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6bc524ea-be07-4b2d-adcc-2969c92b326d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 35322 microversion: 2.1 time: 0.141941 Nov 13 07:54:40.795452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 487/954] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:40 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 35322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:40.868750 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c0583445-54d1-408b-b8bf-6b7e5465d0d1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 35676 microversion: 2.20 time: 0.136537 Nov 13 07:54:40.872834 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 468/955] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:40 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 35676 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:41.815708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:41.818620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:41.826642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:41.827126 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:41.828473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:41.828907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:41.887167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:41.888284 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:41.897742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:41.898191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:41.899017 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:41.899444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:41.948839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4b816044-9193-4bc6-9f1a-024fb586b318 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 36365 microversion: 2.1 time: 0.144602 Nov 13 07:54:41.949641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 488/956] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:41 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 36365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:42.016300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e68fe71-ffc3-4f6f-bce8-5a3984679438 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 36755 microversion: 2.20 time: 0.138113 Nov 13 07:54:42.016948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 469/957] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:41 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 36755 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:42.968242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:42.969205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:42.977024 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:42.977472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:42.978240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:42.978690 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:43.034487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:43.035514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:43.043193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:43.043637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:43.044412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:43.045578 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:43.096999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-67a6668c-eb76-4716-a781-8790e96aea32 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 37326 microversion: 2.1 time: 0.138458 Nov 13 07:54:43.098011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 489/958] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:42 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 37326 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:43.162546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-41396f25-7fc0-4f5f-8a96-19a390fc2637 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 37827 microversion: 2.20 time: 0.137566 Nov 13 07:54:43.163234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 470/959] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:43 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 37827 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:44.116253 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:44.117305 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:44.125131 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:44.125582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:44.126359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:44.126828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:44.182723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:44.183798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:44.193173 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:44.193623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:44.194599 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:44.195057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:44.250933 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6375ea03-2d01-4389-ac46-e180481bd706 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 38131 microversion: 2.1 time: 0.145093 Nov 13 07:54:44.255413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 490/960] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:44 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 38131 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:44.324674 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a950986d-60be-466c-aaeb-271f1ffcca5b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 38197 microversion: 2.20 time: 0.153629 Nov 13 07:54:44.325315 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 471/961] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:44 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 38197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:45.270088 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:45.271148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:45.279283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:45.279735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:45.280517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:45.280952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:45.342912 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:45.343966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:45.351824 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:45.352275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:45.353058 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:45.353496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:47.440657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-84453437-a959-4cf2-a463-23f32bc94b0f tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 38131 microversion: 2.1 time: 2.180991 Nov 13 07:54:47.441395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 491/962] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:45 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 38131 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:47.458856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-44a297b2-3c0a-4ddd-84f1-80fbd3f32ed7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 38197 microversion: 2.20 time: 2.125499 Nov 13 07:54:47.459505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 472/963] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:45 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 38197 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:47.835748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-507530238"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:47.836289 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:47.844557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:47.845008 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:47.845778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:47.846210 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.045912 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.network.security_group_api [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Removing security group 008ed6ca-1746-405a-ab4c-d1129a682e7e from port cb05581f-0d6b-4d29-a731-d459dd0f8143 Nov 13 07:54:48.459937 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:48.461017 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:48.469013 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:48.469534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.470400 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:48.470936 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.589583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-239f369a-6ef7-453e-8789-3137bebe68f4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 38139 microversion: 2.1 time: 0.139677 Nov 13 07:54:48.595376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-17e46012-851a-407f-95f2-2b9b478badcd tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action" status: 202 len: 0 microversion: 2.1 time: 0.769431 Nov 13 07:54:48.595914 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 473/964] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:48 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 38139 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 13 07:54:48.596301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 492/965] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:47 2021] POST /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:48.619301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-23560002-f19d-4b7c-88dd-bb65fd78e473 req-339b24f3-a9f3-4774-901f-9a34dc3d92f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:48.627093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:54:48.627093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:54:48.634055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:48.634055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:48.648164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-23560002-f19d-4b7c-88dd-bb65fd78e473 req-339b24f3-a9f3-4774-901f-9a34dc3d92f3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:48.648605 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-23560002-f19d-4b7c-88dd-bb65fd78e473 req-339b24f3-a9f3-4774-901f-9a34dc3d92f3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.657279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:48.658537 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.659533 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:48.660224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:48.681247 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-23560002-f19d-4b7c-88dd-bb65fd78e473 req-339b24f3-a9f3-4774-901f-9a34dc3d92f3 service nova] Creating event network-changed:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:54:48.695536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-23560002-f19d-4b7c-88dd-bb65fd78e473 req-339b24f3-a9f3-4774-901f-9a34dc3d92f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089676 Nov 13 07:54:48.696592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 493/966] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:54:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:54:48.814376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-01cf1fcd-edd2-42c7-bb78-537a233c7109 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 38275 microversion: 2.20 time: 0.216043 Nov 13 07:54:48.815614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 474/967] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:48 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 38275 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:49.610655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:49.612323 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:49.621871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.622326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.623155 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.623718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.751631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-926ac6b2-e943-4054-9ffc-e03119ae836b tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action" status: 200 len: 38258 microversion: 2.1 time: 0.151872 Nov 13 07:54:49.752263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 494/968] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:54:49 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/action => generated 38258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:49.768634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:49.769224 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:49.777430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.777884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.778699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.779137 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.840540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:49.841534 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:49.842020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-01a0ec4b-ac6c-4566-8c52-4e4020cec56e tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/ips" status: 200 len: 147 microversion: 2.1 time: 0.082758 Nov 13 07:54:49.843035 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 475/969] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:54:49 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/ips => generated 147 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:54:49.850473 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.850950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.851698 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:49.855559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:49.974965 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-64bc7d7a-a7be-4f1a-8a69-6d786a4ea729 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 200 len: 38338 microversion: 2.20 time: 0.145595 Nov 13 07:54:49.976541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 495/970] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:49 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 38338 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:54:49.996005 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:49.996597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:50.004895 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:50.005530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:50.006470 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:50.007100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:50.070352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3b9037e1-33fd-4851-8a4a-aaeabdbdc1ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/ips" status: 200 len: 148 microversion: 2.20 time: 0.088530 Nov 13 07:54:50.071183 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 476/971] 10.222.0.32 () {60 vars in 1288 bytes} [Sat Nov 13 07:54:49 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/ips => generated 148 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:54:51.095904 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:51.096666 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-3f160dd2-fc5c-4fe5-8032-f110525346ea req-9ba1e1c2-e0c5-4cf3-bf61-c6df01394061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:51.097067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:51.108488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:54:51.108488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:54:51.110337 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:51.110906 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:51.111782 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:51.112452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:51.118976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-3f160dd2-fc5c-4fe5-8032-f110525346ea req-9ba1e1c2-e0c5-4cf3-bf61-c6df01394061 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:51.128420 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-3f160dd2-fc5c-4fe5-8032-f110525346ea req-9ba1e1c2-e0c5-4cf3-bf61-c6df01394061 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:51.137547 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-3f160dd2-fc5c-4fe5-8032-f110525346ea req-9ba1e1c2-e0c5-4cf3-bf61-c6df01394061 service nova] Creating event network-changed:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:54:51.143295 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-3f160dd2-fc5c-4fe5-8032-f110525346ea req-9ba1e1c2-e0c5-4cf3-bf61-c6df01394061 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058222 Nov 13 07:54:51.144541 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 477/972] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:54:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:54:51.571168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1a21022c-2df8-4661-a2e3-6df6d2eff580 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments/1d9db4c5-acea-4912-9410-40153ac6dc19" status: 202 len: 0 microversion: 2.1 time: 0.487804 Nov 13 07:54:51.572005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 496/973] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:54:51 2021] DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments/1d9db4c5-acea-4912-9410-40153ac6dc19 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:54:51.587237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:51.588254 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:51.605276 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:51.605729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:51.606527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:51.606996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:51.707965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0fd21ab0-0b3a-42fc-9194-46280f1aafd6 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131015 Nov 13 07:54:51.708655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 478/974] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:54:51 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:54:52.002280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5c56d94-da0a-466c-91d7-108f84bb9720"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:52.004883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:52.022592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:52.023167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:52.024031 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:52.024537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:52.724567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:52.725477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:52.732607 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:52.733059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:52.734343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:52.735080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:52.802553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-652790fb-71b3-469b-afb1-54f0e07ca21c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087237 Nov 13 07:54:52.803130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 479/975] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:54:52 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:54:52.968952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d088cfcd-feab-446e-a63b-676868956803 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980623 Nov 13 07:54:52.969950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 497/976] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:54:51 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:54:53.024521 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:53.026589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:53.034442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.034442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.035412 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.035846 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.107977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lazy-loading 'flavor' on Instance uuid b954e146-2a5c-49d8-a17d-a8299e2a3aed {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:54:53.740594 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-89220456-3491-4737-9b79-f3d12021dd71 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 202 len: 0 microversion: 2.20 time: 0.725727 Nov 13 07:54:53.741235 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 480/977] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:54:53 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:54:53.756052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:53.756696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:53.765742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.768935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.768935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.768935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.820251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:53.821247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:53.829343 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.829770 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.830557 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.831034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.899605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d6510cb3-37d5-499d-b561-cfc60390489c tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089853 Nov 13 07:54:53.900152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 481/978] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:54:53 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:54:53.914787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:53.915284 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:53.922344 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.922906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.923600 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:53.924209 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:53.984453 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:54.005781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:54.012135 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:54.013338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-09079bfc-18b3-4bdb-b9fb-5b220d399403 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.267761 Nov 13 07:54:54.015868 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 498/979] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:54:53 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:54:54.118552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] HTTP exception thrown: Instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d is not attached to volume 1d9db4c5-acea-4912-9410-40153ac6dc19 Nov 13 07:54:54.119198 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Returning 404 to user: Instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d is not attached to volume 1d9db4c5-acea-4912-9410-40153ac6dc19 {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:54:54.120056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f200c85a-49ce-4c66-b67f-f58978d6e002 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments/1d9db4c5-acea-4912-9410-40153ac6dc19" status: 404 len: 154 microversion: 2.1 time: 0.214349 Nov 13 07:54:54.120595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 482/980] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:54:53 2021] DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d/os-volume_attachments/1d9db4c5-acea-4912-9410-40153ac6dc19 => generated 154 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:54:55.048372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:55.048979 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:55.056293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.056749 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:55.057619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.058058 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:55.260025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:55.273314 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:55.279509 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:55.281148 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-77f16d6f-2adc-427e-9970-b48279e631ba tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.242698 Nov 13 07:54:55.281655 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 499/981] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:54:55 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:54:55.518156 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:55.518699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:55.525698 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.526137 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:55.526927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.527350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:55.594952 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:54:55.899916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-62ba168b-6518-4862-9e6b-90ef20e1de92 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 204 len: 0 microversion: 2.1 time: 0.391084 Nov 13 07:54:55.900486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 483/982] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:54:55 2021] DELETE /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:54:55.914517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:55.915149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:55.923931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.924379 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:55.925152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:55.925586 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:56.206717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:56.215053 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d852ea93-20a1-4ea3-966d-3b315eb7867e tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1553 microversion: 2.1 time: 0.310120 Nov 13 07:54:56.215586 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 500/983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:55 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:56.305745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:56.306433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:56.313561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:56.314000 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:56.314791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:56.315218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:56.512036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:56.525813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:56.532620 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:56.533692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-336e0adf-299c-4013-857c-b6f44aaf1de1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.237648 Nov 13 07:54:56.534203 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 484/984] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:54:56 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:54:57.238773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:57.239383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:57.246811 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:57.247260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:57.248051 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:57.248481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:57.448589 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:57.456631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9a93918a-bd2f-4797-a4c5-2bb25d4908a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1553 microversion: 2.1 time: 0.228011 Nov 13 07:54:57.457162 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 501/985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:57 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:57.558048 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:57.558651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:57.567292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:57.567742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:57.568516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:57.568990 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:57.779847 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:57.793230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:57.800052 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:57.801144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a3a04f8a-ef35-49c0-aa41-1337c6bf636d tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.252515 Nov 13 07:54:57.805120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 485/986] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:54:57 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:54:58.479779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:58.480527 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:58.488758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:58.489650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:58.490841 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:58.491554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:58.727889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:58.738237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b051556d-5fdf-4229-aa84-d46fcf75f9a0 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1553 microversion: 2.1 time: 0.268409 Nov 13 07:54:58.738813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 502/987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:58 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:54:58.828313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:58.828928 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:58.836588 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:58.837041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:58.838032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:58.838467 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:58.912858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-56362fbb-5140-4881-b67c-0a3f4a31baac req-8a598775-a336-4ee5-88f8-be530fcdaea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de8d633-5578-4715-96c0-73bf0a8e8b2d", "name": "network-vif-deleted", "tag": "cb05581f-0d6b-4d29-a731-d459dd0f8143"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:54:58.919802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:54:58.919802 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:54:58.928751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-56362fbb-5140-4881-b67c-0a3f4a31baac req-8a598775-a336-4ee5-88f8-be530fcdaea0 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:58.929192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-56362fbb-5140-4881-b67c-0a3f4a31baac req-8a598775-a336-4ee5-88f8-be530fcdaea0 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:58.953860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-56362fbb-5140-4881-b67c-0a3f4a31baac req-8a598775-a336-4ee5-88f8-be530fcdaea0 service nova] Creating event network-vif-deleted:cb05581f-0d6b-4d29-a731-d459dd0f8143 for instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d on hv-cinder-81783 Nov 13 07:54:58.961887 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-56362fbb-5140-4881-b67c-0a3f4a31baac req-8a598775-a336-4ee5-88f8-be530fcdaea0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059105 Nov 13 07:54:58.962986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 503/988] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:54:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:54:59.121771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:59.136090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:59.142515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:59.144012 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-65d1998f-3b10-4cb5-9eb5-971e21ff6bd9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.327605 Nov 13 07:54:59.144717 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 486/989] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:54:58 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:54:59.761740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:54:59.762704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:54:59.770092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:59.770518 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:59.771327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:59.771760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:59.845404 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:54:59.845852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:54:59.846422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lazy-loading 'fault' on Instance uuid 2de8d633-5578-4715-96c0-73bf0a8e8b2d {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:54:59.907900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb408642745e46549caee3557d68e44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf786a8e1ef481fa4403ec4489a3c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:54:59.915963 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5d6acadf-b014-4a19-b024-76bd04d4cb50 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 200 len: 1348 microversion: 2.1 time: 0.164129 Nov 13 07:54:59.916488 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 504/990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:54:59 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 1348 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:00.169885 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:00.170456 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:00.177506 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.177953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.178752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.185747 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.478422 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:00.493111 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:00.499492 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:00.500611 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f4399c36-609d-4112-a051-1d22529fb06a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.339990 Nov 13 07:55:00.501310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 487/991] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:00 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:55:00.890774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:00.891687 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:00.900174 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.900623 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.901399 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.901832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.939441 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:00.940050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] [instance: 2de8d633-5578-4715-96c0-73bf0a8e8b2d] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:00.947390 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.947848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.948637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:00.949075 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:00.974847 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b98b1589-89d2-4832-91bb-e99d60bf48e0 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093102 Nov 13 07:55:00.975304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 505/992] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:55:00 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:00.991955 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:00.992774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:01.000540 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:01.001335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:01.002043 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] HTTP exception thrown: Instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d could not be found. Nov 13 07:55:01.002292 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:01.002658 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Returning 404 to user: Instance 2de8d633-5578-4715-96c0-73bf0a8e8b2d could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:01.003226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:01.003498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-205590fa-d7b5-4ef6-9524-e3aabb4c74cc tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d" status: 404 len: 111 microversion: 2.1 time: 0.074150 Nov 13 07:55:01.004037 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 488/993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:00 2021] GET /compute/v2.1/servers/2de8d633-5578-4715-96c0-73bf0a8e8b2d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:55:01.017027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d99c2b1c-c42f-43f8-aa03-974d6f294733 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] Calling method '.version_select at 0x7f54efdbcee0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:01.074414 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-be1a669c-1f00-4cd6-9bfd-806708928532 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720" status: 200 len: 194 microversion: 2.1 time: 0.092406 Nov 13 07:55:01.075019 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 506/994] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Nov 13 07:55:00 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:01.097179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d99c2b1c-c42f-43f8-aa03-974d6f294733 tempest-TestMinimumBasicScenario-816956332 tempest-TestMinimumBasicScenario-816956332-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-558506700" status: 202 len: 0 microversion: 2.1 time: 0.088801 Nov 13 07:55:01.098976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 489/995] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Nov 13 07:55:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-558506700 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 13 07:55:01.528149 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:01.529368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:01.539101 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:01.539697 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:01.540878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:01.541854 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:01.782499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:01.796461 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:01.802632 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:01.803740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-54f2aa4d-8e50-4b91-b38f-8f2caf403618 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.287686 Nov 13 07:55:01.804255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 507/996] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:01 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:02.829779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:02.830542 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:02.839394 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:02.839984 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:02.841237 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:02.841804 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:03.029237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe0962b0-5675-4c26-91cb-2cda77ad93d7"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:03.031633 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:03.042721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:03.043189 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:03.044171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:03.044789 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:03.096186 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:03.112384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:03.121055 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:03.122197 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-56dd9bc2-9441-4747-93e0-4b19ff709291 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.302911 Nov 13 07:55:03.122961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 490/997] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:02 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:03.808048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f58ff671-948f-46bb-bebe-5d02ad7f6f00 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789038 Nov 13 07:55:03.808702 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 508/998] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Nov 13 07:55:03 2021] POST /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:04.147940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:04.148552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:04.156499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:04.156948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:04.157728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:04.158160 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:04.381827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:04.403222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:04.403222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:04.403542 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a06de33e-8e58-46dc-a155-946f2217a72b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.266573 Nov 13 07:55:04.403901 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 491/999] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:04 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:05.428695 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:05.429398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:05.438247 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:05.438715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:05.439557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:05.439941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:05.696660 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:05.710938 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:05.717582 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:05.718753 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-285e2390-cc1e-443f-b774-d3ef3a01bb32 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1740 microversion: 2.20 time: 0.301193 Nov 13 07:55:05.730711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 509/1000] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:05 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:06.759257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:06.759853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:06.768023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:06.768719 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:06.769504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:06.769942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:07.182486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:07.211728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:07.234651 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:07.243132 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-42462700-c9e1-4bd1-95c4-ef82ce7c4431 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.491937 Nov 13 07:55:07.243472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 492/1001] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:06 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:55:08.267772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:08.271493 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:08.289159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:08.294510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:08.298054 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:08.309373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:08.310646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:08.318304 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:08.337662 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:08.344586 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:08.345723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:08.347534 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:08.584046 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lazy-loading 'flavor' on Instance uuid 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:55:09.021585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:09.070481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:09.090944 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:09.096581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b4d82f48-4ac0-4c06-a97d-f340c9e2777f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.834691 Nov 13 07:55:09.111871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 510/1002] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:08 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:09.128169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f01d68ba-ace8-4c25-877f-c555fc0404f7 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "POST /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908/action" status: 202 len: 0 microversion: 2.1 time: 0.828375 Nov 13 07:55:09.129530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 493/1003] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:55:08 2021] POST /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:09.153845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:09.155005 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:09.162839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:09.164263 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:09.165220 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:09.165824 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:09.278865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-e57fb044-c49d-4371-b5e9-3330c54ac1aa req-f20fb331-a31d-4dd0-b754-9f88f181fc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "name": "network-vif-plugged", "status": "completed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:09.296020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:55:09.296020 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:55:09.316655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-e57fb044-c49d-4371-b5e9-3330c54ac1aa req-f20fb331-a31d-4dd0-b754-9f88f181fc0f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:09.318019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-e57fb044-c49d-4371-b5e9-3330c54ac1aa req-f20fb331-a31d-4dd0-b754-9f88f181fc0f service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:09.351430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-e57fb044-c49d-4371-b5e9-3330c54ac1aa req-f20fb331-a31d-4dd0-b754-9f88f181fc0f service nova] Creating event network-vif-plugged:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:55:09.367167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-e57fb044-c49d-4371-b5e9-3330c54ac1aa req-f20fb331-a31d-4dd0-b754-9f88f181fc0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104685 Nov 13 07:55:09.376357 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 494/1004] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:55:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:09.863339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:09.888030 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-730755f8-68f0-4e96-9b84-29a08677b938 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.753464 Nov 13 07:55:09.903657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 511/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:09 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:10.121396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:10.122515 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:10.130432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:10.131223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:10.132251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:10.132969 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:10.595629 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:10.616339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:10.624743 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:10.626564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-89dc6c88-d059-40ba-b9a0-f53738e00a95 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.515020 Nov 13 07:55:10.638448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 495/1006] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:10 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:10.917972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:10.918579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:10.930682 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:10.931147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:10.931943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:10.941805 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:11.562983 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:11.586897 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-78b73a8a-b5f2-46d2-b78c-6bda5623de95 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.679751 Nov 13 07:55:11.587367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 512/1007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:10 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:11.653476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:11.655345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:11.665532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:11.667373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:11.668590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:11.669244 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.277459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:12.285863 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:12.301374 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.302723 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.306717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.307434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.476921 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3e57583b-0593-4bd8-b9e4-278b915a055a tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.212033 Nov 13 07:55:12.484384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 513/1008] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:55:12 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:12.493863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:12.519586 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:12.532640 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:12.533804 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28a1077f-d48d-40a4-8b71-9dbe41d16500 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.892842 Nov 13 07:55:12.538728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 496/1009] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:11 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:12.608689 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:12.609307 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:12.629902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.630616 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.631601 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.632213 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.746342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:12.754585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:12.766796 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.767522 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.771545 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.772202 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.918634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c3ad1b9c-1806-475c-ab3b-68be8b24f337 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720" status: 200 len: 194 microversion: 2.1 time: 0.184428 Nov 13 07:55:12.924421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 497/1010] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Nov 13 07:55:12 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720 => generated 194 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:12.952263 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:12.953916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:12.975362 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.978062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:12.979531 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:12.983439 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:13.676467 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:13.701724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d8db6df1-f233-426f-853e-cc5a4e299359 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 1.101750 Nov 13 07:55:13.705707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 514/1011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:12 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:13.718359 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:13.720179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b504ad71-af72-49a2-9043-120ef9dca993 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720" status: 202 len: 0 microversion: 2.1 time: 0.793658 Nov 13 07:55:13.724692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 498/1012] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:55:12 2021] DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/d5c56d94-da0a-466c-91d7-108f84bb9720 => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:13.731635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:13.747439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:13.753360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:13.754395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:13.761000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:14.453628 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:14.488557 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:14.497794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:14.510798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d2956c9f-1040-4c65-9a61-4a37d11b7a1b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.801439 Nov 13 07:55:14.512862 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 515/1013] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:13 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:14.737684 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:14.738407 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:14.804219 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:14.805757 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:14.808050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:14.808149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:15.567191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:15.568451 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:15.589915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:15.591325 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:15.596612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:15.596612 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:15.869945 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:15.897218 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cd29a72a-1ddd-4b27-91cf-2494e4e17483 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 1.178388 Nov 13 07:55:15.911987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 499/1014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:14 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:16.085915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:16.141659 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:16.162800 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:16.171262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-35243c84-0e03-41b8-8bac-a25f83f95180 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.639429 Nov 13 07:55:16.176727 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 516/1015] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:15 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:55:16.412859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:16.419915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:16.450446 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.454376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:16.459529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.462706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:16.724964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e04e3fc8-db9b-49ea-b0a6-fb00513a90a8 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/fe0962b0-5675-4c26-91cb-2cda77ad93d7" status: 200 len: 194 microversion: 2.1 time: 0.322114 Nov 13 07:55:16.725883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 500/1016] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Nov 13 07:55:16 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/fe0962b0-5675-4c26-91cb-2cda77ad93d7 => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:16.743379 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:16.745656 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:16.769183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.769930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:16.770929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.771514 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:16.924707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:16.947502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:16.972549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.975776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:16.976592 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:16.977027 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:17.402856 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:17.422098 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fd73aa18-3361-4f32-bba9-e855fd10c577 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.508544 Nov 13 07:55:17.424401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 501/1017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:16 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:17.448402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:17.452786 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:17.465508 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:17.468121 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:17.470058 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:17.472922 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:17.494185 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-11ff388e-8d74-4c4e-b981-334e14b6ba51 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/fe0962b0-5675-4c26-91cb-2cda77ad93d7" status: 202 len: 0 microversion: 2.1 time: 0.761818 Nov 13 07:55:17.495221 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 517/1018] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Nov 13 07:55:16 2021] DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments/fe0962b0-5675-4c26-91cb-2cda77ad93d7 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:17.917773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:17.936725 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:17.944774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:17.946388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ae001db0-a3b2-4325-bd4b-6d10eeba950b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.520910 Nov 13 07:55:17.958548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 502/1019] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:17 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:18.447246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:18.448707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:18.462169 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:18.462928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:18.464048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:18.464704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:18.976387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:18.976387 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:18.989239 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:18.990181 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:18.991866 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:18.992542 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:19.048085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:19.062977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dce7a411-f216-4530-9127-b48255e8d895 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.624042 Nov 13 07:55:19.071864 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 518/1020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:18 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:19.424166 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:19.448486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:19.457520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:19.460136 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c89edf2c-f5eb-4e11-899d-21beb575a3d4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.497909 Nov 13 07:55:19.460915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 503/1021] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:18 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:20.089060 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:20.090293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:20.111082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.111082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:20.111082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.111082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:20.331960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:20.339334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:20.364618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.365067 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:20.365858 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.366456 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:20.541069 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5870cfc8-7bf8-4133-a5c7-8cbd49e96b5d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.237458 Nov 13 07:55:20.562325 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 504/1022] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:55:20 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 25 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 13 07:55:20.590346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:20.591348 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:20.614586 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.615415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:20.618921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:20.619605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:21.104981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:21.117192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-be38b9b6-84da-4684-b99f-67f624a83f3e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 1.042076 Nov 13 07:55:21.119365 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 519/1023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:20 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:21.146144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:21.151842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:21.172197 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:21.173336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:21.174937 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:21.176484 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:21.315235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f353ea85-3204-4fee-9127-ed27670a5b15 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194319 Nov 13 07:55:21.316347 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 520/1024] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Nov 13 07:55:21 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 13 07:55:21.546014 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:21.549550 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:21.565191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:21.565649 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:21.568595 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:21.568595 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:21.755910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Going to try to terminate instance {{(pid=97388) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:55:21.966661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:21.981783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:22.008739 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:22.008739 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5e165f45-de41-4123-bd16-dd21b089956c tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 1.436639 Nov 13 07:55:22.008739 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 505/1025] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:20 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:22.142587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:22.143301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:22.152639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-67ef8b63-3b01-4470-be15-d48d1ee77741 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 204 len: 0 microversion: 2.1 time: 0.632577 Nov 13 07:55:22.154104 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 521/1026] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:55:21 2021] DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:55:22.168749 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:22.169606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:22.177661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:22.178476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:22.179617 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:22.180941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:22.193589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:22.194065 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:22.194916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:22.195352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:22.488498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:22.498446 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a1b51c3f-8367-43e4-b134-59a4d2db2e6d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1674 microversion: 2.1 time: 0.339783 Nov 13 07:55:22.499779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 522/1027] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:22 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1674 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:22.519623 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:22.539614 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ef4ea6b6-05b0-4dd0-9e7d-0591fbc92c89 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.407272 Nov 13 07:55:22.543342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 506/1028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:22 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:23.025885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:23.026503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:23.077744 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.079475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:23.085729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.087384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:23.457741 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:23.473093 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:23.484037 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:23.486087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c059c4e3-ee43-49ea-95ef-380329315272 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.470104 Nov 13 07:55:23.486927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 523/1029] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:23 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:23.527153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:23.527852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:23.547513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.548807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:23.550060 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.552239 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:23.568029 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:23.569531 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:23.590542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.596047 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:23.598950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:23.600385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:24.259643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:24.282501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e5ff8664-78b6-4365-a5f9-a8bbe739197c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.718390 Nov 13 07:55:24.282501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 524/1030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:23 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:24.369808 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:24.388711 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-624b974f-8817-4022-8e64-10a38a2808dd tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1674 microversion: 2.1 time: 0.875703 Nov 13 07:55:24.395561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 507/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:23 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1674 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:24.515919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:24.519554 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:24.578845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:24.578845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:24.578845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:24.578845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:25.016872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:25.046568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:25.053639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:25.054312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2a8f612a-dcad-4d17-adfe-3df99c792c50 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.553416 Nov 13 07:55:25.062935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 525/1032] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:24 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:25.309992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:25.311590 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:25.325942 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:25.329455 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:25.331172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:25.331775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:25.411541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:25.415515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:25.433334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:25.434075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:25.435112 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:25.435727 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:25.846926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:25.877238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-829f1a78-03e8-4da0-be2c-f22a7fd1904d tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1674 microversion: 2.1 time: 0.475319 Nov 13 07:55:25.888663 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 526/1033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:25 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1674 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:26.102078 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:26.102772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:26.111087 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.111566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:26.112368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.112804 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:26.329315 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:26.343548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-92401b92-375e-408a-94d6-8b380464f3bb tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1569 microversion: 2.1 time: 1.049489 Nov 13 07:55:26.347787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 508/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:25 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1569 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:26.377768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:26.378376 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:26.403262 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:26.405923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.410291 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:26.413189 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.413771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:26.437238 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:26.462253 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:26.463959 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-84573b1b-9135-41cc-ba83-df26e1cabc98 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.386605 Nov 13 07:55:26.480555 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 527/1035] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:26 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:55:26.916420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:26.917872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:26.944499 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.945308 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:26.946286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:26.946911 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:27.174200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:27.186609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-503d79b0-f191-4585-93cc-749ca8225bad tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1607 microversion: 2.1 time: 0.289421 Nov 13 07:55:27.188193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 528/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:26 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1607 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:27.306396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c7a39852-2611-4ee7-bb86-79c770fe2021 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "POST /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908/action" status: 202 len: 0 microversion: 2.1 time: 0.945371 Nov 13 07:55:27.318044 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 509/1037] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Nov 13 07:55:26 2021] POST /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:27.321745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:27.322376 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:27.342710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:27.346814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:27.346814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:27.346814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:27.495551 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:27.504573 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:27.525342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:27.526639 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:27.527762 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:27.528419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:27.870946 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:27.885255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e767b70b-2e5f-4632-b635-9940e4c4de96 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1517 microversion: 2.1 time: 0.572355 Nov 13 07:55:27.896205 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 529/1038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:27 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1517 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:28.239106 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:28.244363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:28.290929 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:28.293537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:28.294956 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:28.295967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:28.349758 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:28.403764 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:28.427574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:28.434261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-866318db-0062-487d-9c2c-3a57cc54b99f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.948248 Nov 13 07:55:28.441157 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 510/1039] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:27 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:28.501357 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-cd1a3fbf-eeb5-40bb-82e0-3fd9cd9919bc req-21a61ea5-dbe5-481f-837d-ec3ac015513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53c3e0f-d326-43f9-bfff-2072456b8c6e", "name": "network-vif-deleted", "tag": "0af3e445-8a61-4c2b-8348-8d66fb50e3a6"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:28.530585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:55:28.530585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:55:28.545132 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:28.562642 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9b90af1e-ea94-4c5d-936d-2bc2ebcedd94 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1607 microversion: 2.1 time: 0.357500 Nov 13 07:55:28.572779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-cd1a3fbf-eeb5-40bb-82e0-3fd9cd9919bc req-21a61ea5-dbe5-481f-837d-ec3ac015513d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:28.572779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-cd1a3fbf-eeb5-40bb-82e0-3fd9cd9919bc req-21a61ea5-dbe5-481f-837d-ec3ac015513d service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:28.575147 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 530/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:28 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1607 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:28.629168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-cd1a3fbf-eeb5-40bb-82e0-3fd9cd9919bc req-21a61ea5-dbe5-481f-837d-ec3ac015513d service nova] Creating event network-vif-deleted:0af3e445-8a61-4c2b-8348-8d66fb50e3a6 for instance b53c3e0f-d326-43f9-bfff-2072456b8c6e on hv-cinder-81783 Nov 13 07:55:28.646346 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-cd1a3fbf-eeb5-40bb-82e0-3fd9cd9919bc req-21a61ea5-dbe5-481f-837d-ec3ac015513d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155690 Nov 13 07:55:28.649733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 511/1041] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:28.909740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:28.913472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:28.934053 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:28.934510 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:28.935357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:28.935975 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.299171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:29.312719 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8da84194-fd30-4402-b2f1-bde51ba4a795 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1519 microversion: 2.1 time: 0.412753 Nov 13 07:55:29.329867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 531/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:28 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:29.405872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-efc04934-9a02-48c0-aa22-ebfff505cfd7 req-8f19ef64-804c-4f92-b329-df2eed65ce0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "name": "network-vif-unplugged", "status": "completed", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:29.416939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:55:29.416939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:55:29.432571 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-efc04934-9a02-48c0-aa22-ebfff505cfd7 req-8f19ef64-804c-4f92-b329-df2eed65ce0e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.433238 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-efc04934-9a02-48c0-aa22-ebfff505cfd7 req-8f19ef64-804c-4f92-b329-df2eed65ce0e service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.460728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.compute.server_external_events [req-efc04934-9a02-48c0-aa22-ebfff505cfd7 req-8f19ef64-804c-4f92-b329-df2eed65ce0e service nova] Unable to find a host for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908. Dropping event network-vif-unplugged {{(pid=97389) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 13 07:55:29.463036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-efc04934-9a02-48c0-aa22-ebfff505cfd7 req-8f19ef64-804c-4f92-b329-df2eed65ce0e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089644 Nov 13 07:55:29.464051 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 512/1043] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:55:29 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 13 07:55:29.465270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:29.465869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:29.476846 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.477561 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.478538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.479164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.608429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:29.614566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:29.638320 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.639171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.640340 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.640944 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.736491 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:29.736943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:29.737552 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lazy-loading 'fault' on Instance uuid b53c3e0f-d326-43f9-bfff-2072456b8c6e {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:55:29.873152 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:29.902229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:29.911966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:29.915707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2ad271ff-df1f-4b89-a961-8142e46713f2 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.457754 Nov 13 07:55:29.915707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 532/1044] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:29 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:30.029617 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef6287046b64615abf251066d342bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728dba4850df46759bff46353cf16a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:30.051687 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c93a83ce-95d0-4404-929a-1de02068eda4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 200 len: 1327 microversion: 2.1 time: 0.474692 Nov 13 07:55:30.062164 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 513/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:29 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 1327 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:30.336346 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:30.336884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:30.349244 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:30.349975 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:30.350950 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:30.351717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:30.669207 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:30.686360 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-035486ae-7993-4ce3-86e0-d5d1df8aacea tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1519 microversion: 2.1 time: 0.359412 Nov 13 07:55:30.701433 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 533/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:30 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1519 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:30.939341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:30.943961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:30.962733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:30.962733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:30.964303 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:30.964875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:31.074577 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:31.075224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:31.086168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:31.086630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:31.087439 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:31.087875 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:31.141100 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. Nov 13 07:55:31.141911 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:31.142951 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5856af20-067a-42dc-a75c-c480e28e1835 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 404 len: 111 microversion: 2.1 time: 0.077588 Nov 13 07:55:31.147516 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 534/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:31 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:31.158567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-933e27e0-f466-4537-99f9-c869c41041c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '.version_select at 0x7f54efd6cb80>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:31.326268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-933e27e0-f466-4537-99f9-c869c41041c4 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392057867" status: 202 len: 0 microversion: 2.1 time: 0.176859 Nov 13 07:55:31.327038 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 535/1048] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Nov 13 07:55:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392057867 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:31.720827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:31.721358 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:31.731241 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:31.733708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:31.741871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:31.742501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:31.765324 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:31.807875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:31.834715 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:31.836950 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a66e4d6b-59f8-444e-b44c-498662d77ef3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1735 microversion: 2.20 time: 0.907809 Nov 13 07:55:31.839606 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 514/1049] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:30 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1735 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:32.425550 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:32.440161 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-751979ff-e419-4655-a94e-5f34bfc01a34 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1519 microversion: 2.1 time: 0.732827 Nov 13 07:55:32.442421 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 536/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:31 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1519 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:32.868733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:32.870142 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:32.879943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:32.880393 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:32.881626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:32.882069 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:33.464369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:33.465604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:33.474057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:33.474798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:33.475772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:33.476371 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:33.661363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:33.676153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:33.683105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:33.684447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-310d3621-1674-48e7-9d28-566ffacb8eef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1717 microversion: 2.20 time: 0.830365 Nov 13 07:55:33.685152 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 515/1051] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:32 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1717 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:33.695881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:33.704585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-66333e9f-f95e-4aff-a642-d04f6d9b0776 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.251392 Nov 13 07:55:33.705281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 537/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:33 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:34.711512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:34.712463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:34.722268 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:34.723010 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:34.724059 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:34.724707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:34.734708 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:34.736167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:34.745606 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:34.746280 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:34.747250 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:34.747765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:35.000931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:35.004046 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:35.010563 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-745176ac-cc62-465d-960a-9423bf5f1150 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.290199 Nov 13 07:55:35.018661 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:35.019091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 538/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:34 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:35.025261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:35.026356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2779ce15-a4b0-4d7c-9347-07d407656be1 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1717 microversion: 2.20 time: 0.326989 Nov 13 07:55:35.026887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 516/1054] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:34 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:35.302065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Action: 'create', calling method: .version_select at 0x7f54efd26af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-243676093"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:35.328888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for project 223449528a9f41b596ada04fa1f9290d. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:55:35.332635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for user 1ff81de9cef042ef81e2463b48087197 and project 223449528a9f41b596ada04fa1f9290d. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:55:35.702869 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for project 223449528a9f41b596ada04fa1f9290d. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:55:35.706604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for user 1ff81de9cef042ef81e2463b48087197 and project 223449528a9f41b596ada04fa1f9290d. Resources: {'key_pairs'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:55:35.719842 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-77abdb9a-711e-4a81-aa96-f70f112be636 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.619052 Nov 13 07:55:35.720459 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 539/1055] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Nov 13 07:55:35 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:35.741525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:35.742018 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:35.749129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:35.749587 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:35.750374 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:35.750854 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:35.803085 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. Nov 13 07:55:35.803692 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:35.804517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d71f016e-0d61-44c2-8cf2-079479999e95 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 404 len: 111 microversion: 2.1 time: 0.073098 Nov 13 07:55:35.805049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 517/1056] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:55:35 2021] DELETE /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:35.818370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:35.819001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: b53c3e0f-d326-43f9-bfff-2072456b8c6e] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:35.826298 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:35.826903 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:35.829907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:35.829907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:35.880913 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. Nov 13 07:55:35.881515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance b53c3e0f-d326-43f9-bfff-2072456b8c6e could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:35.882344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4d12f31b-bb50-439e-82b4-3ce2644f9659 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e" status: 404 len: 111 microversion: 2.1 time: 0.073163 Nov 13 07:55:35.882926 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 540/1057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:35 2021] GET /compute/v2.1/servers/b53c3e0f-d326-43f9-bfff-2072456b8c6e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:36.034749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:36.035493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:36.045088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.045088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.045088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.045546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.055883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:36.056577 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:36.072614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.073077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.073931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.074381 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.253143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:36.263186 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f8a7b683-ebf6-4a14-972f-74d636bface3 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.239058 Nov 13 07:55:36.264012 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 518/1058] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:36 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:36.312821 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:36.328896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:36.335183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:36.336321 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3329dc58-11b1-483f-8fa9-42f11224ede7 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1720 microversion: 2.20 time: 0.295488 Nov 13 07:55:36.336847 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 541/1059] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:36 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:36.367697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "024ce5fd-66f1-4b0f-ab75-53d175d4fec0"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:36.367697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:36.369724 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.370173 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.370987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.371424 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.385916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-27c1e482-c258-479d-a5f3-ca10036e7718 req-1fe631d7-bc7b-4453-aea1-31d2c9c6559a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "name": "network-vif-unplugged", "status": "completed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:36.392803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:55:36.392803 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:55:36.401696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-27c1e482-c258-479d-a5f3-ca10036e7718 req-1fe631d7-bc7b-4453-aea1-31d2c9c6559a service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:36.402136 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-27c1e482-c258-479d-a5f3-ca10036e7718 req-1fe631d7-bc7b-4453-aea1-31d2c9c6559a service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:36.417287 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-27c1e482-c258-479d-a5f3-ca10036e7718 req-1fe631d7-bc7b-4453-aea1-31d2c9c6559a service nova] Creating event network-vif-unplugged:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:55:36.422015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-27c1e482-c258-479d-a5f3-ca10036e7718 req-1fe631d7-bc7b-4453-aea1-31d2c9c6559a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045066 Nov 13 07:55:36.422814 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 542/1060] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:37.285986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:37.286817 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:37.294266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.294729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.295489 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.295916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.506596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:37.515500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-473a4738-599b-4b58-ae0c-2e954d2b1396 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.239197 Nov 13 07:55:37.524647 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 543/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:37 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:37.526447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:37.526447 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:37.533621 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.534067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.534881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.535341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.588876 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. Nov 13 07:55:37.589564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:37.590393 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9488ea7f-af70-45b6-8a6a-1669d3f7b9b1 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 404 len: 111 microversion: 2.1 time: 0.073291 Nov 13 07:55:37.591000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 544/1062] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:55:37 2021] DELETE /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:37.604106 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:37.604722 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] [instance: 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:37.612743 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.613195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.613977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:37.614413 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:37.664522 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] HTTP exception thrown: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. Nov 13 07:55:37.665130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] Returning 404 to user: Instance 9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:37.665944 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bcaf5fdd-3f7c-4551-be93-9e6241a48a98 tempest-AttachVolumeTestJSON-1777995253 tempest-AttachVolumeTestJSON-1777995253-project] 10.222.0.32 "GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6" status: 404 len: 111 microversion: 2.1 time: 0.071070 Nov 13 07:55:37.666747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 545/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:37 2021] GET /compute/v2.1/servers/9e1a4e6d-d79b-4c14-b0a5-77243c8f47a6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:55:37.917108 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-710ff8b2-fb74-43aa-8475-50ff15898c8e tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.566244 Nov 13 07:55:37.917697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 519/1064] 10.222.0.32 () {62 vars in 1363 bytes} [Sat Nov 13 07:55:36 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments => generated 188 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 13 07:55:38.135199 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:38.135711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:38.143004 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:38.145676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:38.145676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:38.145676 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:38.542090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:38.543002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:38.551581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:38.552605 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:38.553564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:38.567805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:38.933496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:38.948085 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-59e83e27-db4c-4bd8-9c87-8979838c5d1f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.419228 Nov 13 07:55:38.958848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 520/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:38 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:39.031036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-75bbdaf5-c665-49ea-a9e4-76d19fcf0511 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments/024ce5fd-66f1-4b0f-ab75-53d175d4fec0" status: 202 len: 0 microversion: 2.20 time: 0.905322 Nov 13 07:55:39.032707 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 546/1066] 10.222.0.32 () {60 vars in 1456 bytes} [Sat Nov 13 07:55:38 2021] DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments/024ce5fd-66f1-4b0f-ab75-53d175d4fec0 => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:55:39.146641 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:39.147238 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:39.161212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:39.161684 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:39.162540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:39.163070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:39.714023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f6b3016d-736d-4a7a-af59-40a72beb0fc4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action" status: 202 len: 0 microversion: 2.20 time: 0.579040 Nov 13 07:55:39.717672 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 521/1067] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Nov 13 07:55:39 2021] POST /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:55:39.733668 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:39.736968 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:39.749480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:39.750022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:39.750915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:39.751352 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:39.973648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:39.975293 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:39.985983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:39.998587 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:40.002868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:40.008649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:40.008649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:40.008649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:40.008972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:40.008972 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-788dd353-4c57-461e-9741-f1540f48b603 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1668 microversion: 2.20 time: 0.289047 Nov 13 07:55:40.009767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 547/1068] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:39 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1668 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:40.381687 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:40.390910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-907fc054-604a-4ba5-b580-fc2a3b408893 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.429094 Nov 13 07:55:40.391447 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 522/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:39 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:41.037159 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:41.038283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:41.046534 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:41.047084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:41.047928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:41.048449 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:41.266813 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:41.282299 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:41.288928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:41.290065 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e2ebdd06-f7e7-4bd1-b13b-346fdb155de6 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1670 microversion: 2.20 time: 0.264634 Nov 13 07:55:41.290579 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 548/1070] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:41 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:41.414382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:41.415056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:41.422194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:41.422722 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:41.423679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:41.424113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:41.931757 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:41.943925 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-413a16aa-6931-4fcb-99ba-c0ca79b762af tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.538933 Nov 13 07:55:41.945003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 523/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:41 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:42.326062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:42.327338 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:42.347006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:42.352428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:42.354909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:42.355928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:42.967670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:42.968494 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:42.971482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:42.977518 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:42.978366 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:42.979545 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:42.980182 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:43.002079 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:43.009832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:43.016111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fca2665a-90ef-4e14-b402-37c87402730a tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1670 microversion: 2.20 time: 0.711002 Nov 13 07:55:43.017256 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 549/1072] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:42 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1670 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:43.226081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:43.236948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3e9a7ee1-4c2e-4fd1-944b-a5baa471c910 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.279288 Nov 13 07:55:43.247790 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 524/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:42 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:44.041691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:44.047747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:44.063564 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:44.065641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:44.068056 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:44.068724 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:44.267960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:44.268650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:44.292618 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:44.303487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:44.304602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:44.305196 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:44.471123 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:44.506067 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:44.522832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:44.524537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c51d592c-0663-4f2e-91de-0d2c9ef6c891 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.493387 Nov 13 07:55:44.538888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 550/1074] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:44 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:44.946721 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:44.964871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-299ca2b9-5560-4fba-ad19-14ab0e6db583 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.705361 Nov 13 07:55:44.964871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 525/1075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:44 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:45.559916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:45.560620 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:45.576286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:45.577255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:45.578255 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:45.579080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:45.985645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:45.986436 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:46.017708 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:46.018580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:46.022575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:46.026502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:46.235412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:46.263871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:46.282289 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:46.283942 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-142051a1-3c29-4469-a8d0-252a796c2d4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.742429 Nov 13 07:55:46.286630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 551/1076] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:45 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:46.464431 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:46.474287 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2da0cf0d-eade-414e-883b-7cdde370eb03 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.505872 Nov 13 07:55:46.485943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 526/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:45 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:55:47.139001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-310b00b6-13d8-43eb-befc-dbeac3c4da3a req-1447febd-827c-4932-8c4c-fb9a4ed9b2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "name": "network-vif-plugged", "status": "completed", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:47.150567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:55:47.150567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:55:47.173010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-310b00b6-13d8-43eb-befc-dbeac3c4da3a req-1447febd-827c-4932-8c4c-fb9a4ed9b2ac service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:47.173631 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-310b00b6-13d8-43eb-befc-dbeac3c4da3a req-1447febd-827c-4932-8c4c-fb9a4ed9b2ac service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:47.198571 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-310b00b6-13d8-43eb-befc-dbeac3c4da3a req-1447febd-827c-4932-8c4c-fb9a4ed9b2ac service nova] Creating event network-vif-plugged:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:55:47.205978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-310b00b6-13d8-43eb-befc-dbeac3c4da3a req-1447febd-827c-4932-8c4c-fb9a4ed9b2ac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075382 Nov 13 07:55:47.205978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 552/1078] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:55:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:47.313865 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:47.321212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:47.323226 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:47.323863 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:47.324869 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:47.325480 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:47.508675 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:47.510715 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:47.536492 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:47.537229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:47.538266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:47.539025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:47.648906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:47.674050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:47.682549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:47.684191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2d423b6a-cd6e-4255-9567-495fca9bc107 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.383368 Nov 13 07:55:47.685301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 527/1079] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:47 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:47.939229 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:47.949027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4df8836e-66f9-4a05-8a86-7eeee9a6bc32 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.459855 Nov 13 07:55:47.949919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 553/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:47 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:48.709637 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:48.710243 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:48.717898 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:48.718373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:48.719223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:48.719631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:48.981383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:48.982648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:48.990503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:48.991242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:48.992198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:48.992816 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:49.014475 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:49.047591 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:49.067916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:49.086200 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ebb271fb-f7f2-47c6-af0e-76edf52f1b87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.386971 Nov 13 07:55:49.087011 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 528/1081] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:48 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:49.350783 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:49.362852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-eadd9724-4b44-44f8-aeb6-9987bac8f707 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.390758 Nov 13 07:55:49.363755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 554/1082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:48 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:49.997204 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-35e28ae5-3f4e-4415-b485-286b23ac72eb tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Action: 'create', calling method: .version_select at 0x7f54efa14160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1833343091"}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:50.117477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:50.120424 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:50.130491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:50.135412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:50.135412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:50.135412 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:50.365027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:50.389663 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:50.397437 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:50.399240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-41dac656-60e4-4e61-935c-ae16aedbe8e5 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.297751 Nov 13 07:55:50.400408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 555/1083] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:50 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:50.412506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:50.413966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:50.424538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:50.424977 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:50.426919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:50.426919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:50.779260 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:50.792075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ca926b6a-2318-418d-bc01-3baefc47ab6b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.386654 Nov 13 07:55:50.792075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 556/1084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:50 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:50.915915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-35e28ae5-3f4e-4415-b485-286b23ac72eb tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.071239 Nov 13 07:55:50.918736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 529/1085] 10.222.0.32 () {60 vars in 1154 bytes} [Sat Nov 13 07:55:49 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1075 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 13 07:55:50.934952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1fb8e88a-1daa-4506-8b1d-b12129e6c8ee tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efc59280>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:51.037223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1fb8e88a-1daa-4506-8b1d-b12129e6c8ee tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 200 len: 345 microversion: 2.1 time: 0.110394 Nov 13 07:55:51.037223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 557/1086] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:55:50 2021] GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:51.424793 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:51.425476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:51.434149 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:51.434997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:51.436016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:51.436828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:51.673417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:51.690248 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:51.696883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:51.698012 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-312c8fb2-a656-42ad-9b9b-b7c20853fbf9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.284181 Nov 13 07:55:51.698528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 530/1087] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:51 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:55:51.811650 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:51.813214 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:51.821896 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:51.822621 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:51.823902 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:51.824501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:52.055437 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-118c470d-4727-43b2-8e6a-07c277dce4ae tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa144c0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:52.058657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:52.067677 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0baa2ce1-1419-4fd5-b7fc-43cb3812a53a tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.266095 Nov 13 07:55:52.068481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 558/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:51 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:52.161369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-118c470d-4727-43b2-8e6a-07c277dce4ae tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 200 len: 346 microversion: 2.1 time: 0.116266 Nov 13 07:55:52.162185 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 531/1089] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:55:52 2021] GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:52.182090 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2e616000-4af1-44e7-935c-a130f2380e80 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Action: 'create', calling method: .version_select at 0x7f54efc599d0>, body: {"snapshot": {"volume_id": "92e3f076-d77c-46d3-b33a-80eea688049b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1631625744"}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:55:52.663016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2e616000-4af1-44e7-935c-a130f2380e80 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.487680 Nov 13 07:55:52.663016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 559/1090] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Nov 13 07:55:52 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:52.675738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-698124bd-0191-48ca-beb8-eb1e29d8e4a8 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efccc8b0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:52.726639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:52.727829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:52.743295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:52.745536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:52.747414 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:52.748271 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:52.753229 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-698124bd-0191-48ca-beb8-eb1e29d8e4a8 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.088185 Nov 13 07:55:52.753783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 532/1091] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:52 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:52.769225 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-34ea5978-2984-40d3-ad99-a17d111f7a18 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa14d30>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:52.821390 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-34ea5978-2984-40d3-ad99-a17d111f7a18 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.061492 Nov 13 07:55:52.821946 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 533/1092] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Nov 13 07:55:52 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:52.837992 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-352b48bf-ab3c-4f8e-b549-60fda1ebcbd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efc7b790>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:52.898616 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-352b48bf-ab3c-4f8e-b549-60fda1ebcbd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.070460 Nov 13 07:55:52.899870 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 534/1093] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:52 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:55:52.996522 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:53.009673 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:53.015947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:53.017052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-bc53e8f6-8e70-44e3-afb8-a14864ba66aa tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.302855 Nov 13 07:55:53.017572 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 560/1094] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:52 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:53.094564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:53.107427 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:53.120304 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:53.120747 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:53.121562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:53.122179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:53.358076 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:53.367440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e39e30c-2703-4b35-a903-63b856374c2b tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.285095 Nov 13 07:55:53.367975 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 535/1095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:53 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:53.916603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-303940dd-cffe-4f47-9106-890f2643c830 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efec65e0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:53.966383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-303940dd-cffe-4f47-9106-890f2643c830 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.058798 Nov 13 07:55:53.967082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 561/1096] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:53 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:54.040785 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:54.041385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:54.048558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:54.049000 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:54.049765 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:54.050194 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:54.250483 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:54.265328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:54.271631 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:54.272726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a7b92bf5-15f9-4089-9b9d-49bb526c1e04 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.241144 Nov 13 07:55:54.273235 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 536/1097] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:54 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:54.389523 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:54.390119 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:54.398130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:54.398856 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:54.399824 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:54.400411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:54.611008 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:54.619396 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-fa6fa920-be62-4a57-9b91-1bf09ae8b41c tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.239523 Nov 13 07:55:54.620144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 562/1098] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:54 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:54.990558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7e06bd08-d210-43ec-b38d-b055acd89a20 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efccc9d0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:55.038733 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7e06bd08-d210-43ec-b38d-b055acd89a20 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.059202 Nov 13 07:55:55.039292 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 537/1099] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:54 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:55.341949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:55.341949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:55.341949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:55.341949 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:55.342735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:55.342735 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:55.523224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:55.536511 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:55.542745 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:55.544343 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-75410e0a-7dc5-48e2-98ce-719f337c2fee tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.256323 Nov 13 07:55:55.544861 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 563/1100] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:55 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:55.641967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:55.642576 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:55.650448 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:55.650953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:55.651766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:55.652203 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:55.852125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:55.860921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5c2d9f23-1d6c-4efa-af18-85d350ead6dc tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.228127 Nov 13 07:55:55.861452 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 538/1101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:55 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:56.055630 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9ecd401e-88b8-4450-bf67-57eb9db568b6 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efd54670>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:56.102206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9ecd401e-88b8-4450-bf67-57eb9db568b6 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.055534 Nov 13 07:55:56.102829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 564/1102] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:56 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:56.568564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:56.569113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:56.577003 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:56.577509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:56.578513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:56.578958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:56.777755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:56.790955 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:56.797072 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:56.798153 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d0b18761-41fe-47ef-9998-2fea85e1b80b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.239342 Nov 13 07:55:56.798693 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 539/1103] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:56 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:56.882934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:56.883542 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:56.891981 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:56.892427 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:56.893191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:56.893623 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:57.093588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:57.101701 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-3b62657c-e51d-416e-b89b-845eaa441fb4 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1575 microversion: 2.1 time: 0.227944 Nov 13 07:55:57.102228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 565/1104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:56 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:57.120212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-625ca418-58a4-43ba-9436-ee0f5194d20c tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa14b80>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:57.166579 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-625ca418-58a4-43ba-9436-ee0f5194d20c tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 288 microversion: 2.1 time: 0.055241 Nov 13 07:55:57.167170 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 540/1105] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:57 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:57.183477 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-a97e9429-fb72-4b66-8feb-5a2832a54800 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efc59af0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:57.362301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-a97e9429-fb72-4b66-8feb-5a2832a54800 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 202 len: 0 microversion: 2.1 time: 0.184104 Nov 13 07:55:57.362301 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 566/1106] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Nov 13 07:55:57 2021] DELETE /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:57.373287 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b0e70eb4-2e23-4680-9ad7-d75c9eb28412 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa14820>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:57.420890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b0e70eb4-2e23-4680-9ad7-d75c9eb28412 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 200 len: 287 microversion: 2.1 time: 0.057157 Nov 13 07:55:57.423957 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 541/1107] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:57 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:57.822235 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:57.822857 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:57.831171 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:57.831614 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:57.832370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:57.832797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:58.029286 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:58.042567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:58.048936 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:58.050017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-954de707-ff28-41ca-b74e-80943756afcc tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.237044 Nov 13 07:55:58.050588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 567/1108] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:57 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:58.124523 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:58.125036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:58.132231 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:58.132681 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:58.133457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:58.133892 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:58.339496 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:58.348080 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3718b238-5b1f-48f6-aa4f-3fbbd14c776f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1562 microversion: 2.1 time: 0.232709 Nov 13 07:55:58.348593 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 542/1109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:55:58 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:55:58.437775 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-896e69ca-cd9e-4911-8e72-0825db734cd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efd26040>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:58.481567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-896e69ca-cd9e-4911-8e72-0825db734cd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] HTTP exception thrown: Snapshot 2480aba4-854e-4d8f-b288-260efb09076e could not be found. Nov 13 07:55:58.482190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-896e69ca-cd9e-4911-8e72-0825db734cd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Returning 404 to user: Snapshot 2480aba4-854e-4d8f-b288-260efb09076e could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:58.483016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-896e69ca-cd9e-4911-8e72-0825db734cd2 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e" status: 404 len: 111 microversion: 2.1 time: 0.054393 Nov 13 07:55:58.483547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 568/1110] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Nov 13 07:55:58 2021] GET /compute/v2.1/os-snapshots/2480aba4-854e-4d8f-b288-260efb09076e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:58.497138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6360bc10-69bc-4fc3-a90f-fc4eccc4193f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa14430>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:58.733505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6360bc10-69bc-4fc3-a90f-fc4eccc4193f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 202 len: 0 microversion: 2.1 time: 0.245329 Nov 13 07:55:58.734137 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 543/1111] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:55:58 2021] DELETE /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:55:58.748964 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-68a58cf0-37c8-4274-8ec8-c63dcfaefec0 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54effb4940>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:58.843799 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-68a58cf0-37c8-4274-8ec8-c63dcfaefec0 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 200 len: 345 microversion: 2.1 time: 0.104991 Nov 13 07:55:58.844428 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 569/1112] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:55:58 2021] GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:55:59.074086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:59.074779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:55:59.082970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:59.083419 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:59.084232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:55:59.084664 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:55:59.400577 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:59.414916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:59.421371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:55:59.422478 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4a426896-86d4-4f01-8deb-bbab5b14e991 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.357794 Nov 13 07:55:59.423053 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 544/1113] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:55:59 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:55:59.862164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c41cb2d1-1ab1-4092-8802-589fa2c7d367 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efec65e0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:55:59.928629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-c41cb2d1-1ab1-4092-8802-589fa2c7d367 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] HTTP exception thrown: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. Nov 13 07:55:59.928629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c41cb2d1-1ab1-4092-8802-589fa2c7d367 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Returning 404 to user: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:55:59.928629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c41cb2d1-1ab1-4092-8802-589fa2c7d367 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 404 len: 109 microversion: 2.1 time: 0.072692 Nov 13 07:55:59.928629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 570/1114] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:55:59 2021] GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:55:59.945120 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-91e43266-8ad8-432b-9c5a-e67e2d61b959 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efc7bd30>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:00.010989 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-91e43266-8ad8-432b-9c5a-e67e2d61b959 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] HTTP exception thrown: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. Nov 13 07:56:00.012159 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-91e43266-8ad8-432b-9c5a-e67e2d61b959 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Returning 404 to user: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:00.012970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-91e43266-8ad8-432b-9c5a-e67e2d61b959 tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 404 len: 109 microversion: 2.1 time: 0.076992 Nov 13 07:56:00.013519 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 545/1115] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:55:59 2021] DELETE /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:00.026815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f383008a-8167-4edf-a149-7ff32be6394f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Calling method '.version_select at 0x7f54efa390d0>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:00.088943 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-f383008a-8167-4edf-a149-7ff32be6394f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] HTTP exception thrown: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. Nov 13 07:56:00.089535 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f383008a-8167-4edf-a149-7ff32be6394f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] Returning 404 to user: Volume 92e3f076-d77c-46d3-b33a-80eea688049b could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:00.091027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f383008a-8167-4edf-a149-7ff32be6394f tempest-VolumesSnapshotsTestJSON-1876441079 tempest-VolumesSnapshotsTestJSON-1876441079-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b" status: 404 len: 109 microversion: 2.1 time: 0.073310 Nov 13 07:56:00.091546 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 571/1116] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:56:00 2021] GET /compute/v2.1/os-volumes/92e3f076-d77c-46d3-b33a-80eea688049b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:00.447230 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:00.451499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:00.455727 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:00.456186 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:00.457016 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:00.457504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:00.717793 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:00.731996 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:00.738936 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:00.739648 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c508cde6-7a75-4cf4-8327-3dc35ab88a14 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.302817 Nov 13 07:56:00.740345 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 546/1117] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:00 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:01.764046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:01.765246 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:01.772533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:01.772990 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:01.773774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:01.774206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:01.982113 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:01.996810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:02.003431 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:02.004638 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ac32d360-6a6f-49b0-b84b-64cd4fcfc0a0 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.249990 Nov 13 07:56:02.005237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 572/1118] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:01 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:02.940070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-618521531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-243676093", "security_groups": [{"name": "tempest-secgroup-smoke-630266333"}], "block_device_mapping_v2": [{"uuid": "9c33db47-f3c5-4b88-9aef-4b6dfbe99e01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b18ecf6-b62e-4677-b0e9-18dde6071eff"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:03.029749 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:03.030348 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:03.037500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:03.037970 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:03.038771 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:03.039295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:03.204585 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] validate_networks() for [('5b18ecf6-b62e-4677-b0e9-18dde6071eff', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:56:03.271974 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:03.287130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:03.293688 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:03.294907 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-198819ad-3a25-4cb2-ad7b-73ce6e13f7ef tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.274978 Nov 13 07:56:03.295807 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 573/1119] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:03 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:56:03.947398 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:56:03.947889 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:56:03.948399 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:56:03.948838 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:56:03.949329 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:56:03.957681 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:03.958130 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:03.958967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:03.959402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:03.976604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:56:03.981196 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for user 1ff81de9cef042ef81e2463b48087197 and project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:56:04.084778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:56:04.087113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c33db47-f3c5-4b88-9aef-4b6dfbe99e01',volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:56:04.318137 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:04.318934 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:04.329041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:04.329041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:04.329041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:04.329041 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:04.550528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:04.566528 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:04.573216 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:04.582843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b4f1f1d8-650a-4db7-a613-849c21480428 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.266053 Nov 13 07:56:04.582843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 574/1120] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:04 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 13 07:56:04.619313 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-344ce6e4-c9b7-4f93-93d1-99f71b711445 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.688200 Nov 13 07:56:04.620028 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 547/1121] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:56:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:56:04.639641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b7346637-e229-4111-9933-d58fda3c6d93 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:04.640259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b7346637-e229-4111-9933-d58fda3c6d93 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:04.644975 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-63e0d083-50fc-4198-aa01-b39cc1e4b870 req-0c5b745e-8562-4ec8-9c69-ab9c61d9e050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "name": "network-vif-plugged", "status": "completed", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:04.651516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:56:04.651516 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:56:04.661309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-63e0d083-50fc-4198-aa01-b39cc1e4b870 req-0c5b745e-8562-4ec8-9c69-ab9c61d9e050 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:04.662306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-63e0d083-50fc-4198-aa01-b39cc1e4b870 req-0c5b745e-8562-4ec8-9c69-ab9c61d9e050 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:04.678322 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-63e0d083-50fc-4198-aa01-b39cc1e4b870 req-0c5b745e-8562-4ec8-9c69-ab9c61d9e050 service nova] Creating event network-vif-plugged:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:56:04.683745 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-63e0d083-50fc-4198-aa01-b39cc1e4b870 req-0c5b745e-8562-4ec8-9c69-ab9c61d9e050 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047824 Nov 13 07:56:04.684350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 548/1122] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:56:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:56:04.756744 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b7346637-e229-4111-9933-d58fda3c6d93 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:04.769237 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b7346637-e229-4111-9933-d58fda3c6d93 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1093 microversion: 2.1 time: 0.142501 Nov 13 07:56:04.772960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 575/1123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:04 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1093 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:05.600257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:05.600980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:05.610007 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:05.610726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:05.613964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:05.613964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:05.796583 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-f1fa7a5b-c8e5-4036-822d-98a0c5f680c9 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:05.798242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-f1fa7a5b-c8e5-4036-822d-98a0c5f680c9 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:05.837125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:05.851438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:05.858307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:05.859782 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-4d3b0de4-e95a-403e-a6c8-f9522071b42f tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.270137 Nov 13 07:56:05.860558 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 549/1124] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:05 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:05.894166 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-f1fa7a5b-c8e5-4036-822d-98a0c5f680c9 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:05.904183 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-f1fa7a5b-c8e5-4036-822d-98a0c5f680c9 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1093 microversion: 2.1 time: 0.121412 Nov 13 07:56:05.913839 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 576/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:05 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1093 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:06.884469 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:06.885101 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:06.892813 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:06.896707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:06.896707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:06.896707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:06.927170 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0e7134de-5163-4740-a65c-faa7893cd4bf tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:06.927777 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0e7134de-5163-4740-a65c-faa7893cd4bf tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:07.008165 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0e7134de-5163-4740-a65c-faa7893cd4bf tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:07.016111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0e7134de-5163-4740-a65c-faa7893cd4bf tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1093 microversion: 2.1 time: 0.098892 Nov 13 07:56:07.025091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 577/1126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:06 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:07.330338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:07.343921 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:07.350172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:07.351326 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-65d274cb-f80f-4611-bbb8-a6f0eb930ca3 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1726 microversion: 2.20 time: 0.476184 Nov 13 07:56:07.351849 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 550/1127] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:06 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1726 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:08.039218 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-255944c6-b43c-4ba5-bd53-561cf03f9679 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:08.040008 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-255944c6-b43c-4ba5-bd53-561cf03f9679 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:08.128654 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-255944c6-b43c-4ba5-bd53-561cf03f9679 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:08.137295 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-255944c6-b43c-4ba5-bd53-561cf03f9679 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1093 microversion: 2.1 time: 0.107567 Nov 13 07:56:08.137978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 578/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:08 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1093 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:08.375035 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:08.375634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:08.382701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:08.383144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:08.383904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:08.384328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:08.614699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:08.628685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:08.635104 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:08.636222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6e160fd6-2fd8-41db-a411-062ed039f828 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1713 microversion: 2.20 time: 0.270918 Nov 13 07:56:08.636738 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 551/1129] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:08 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1713 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:09.159130 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:09.159738 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:09.167231 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:09.167730 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:09.168552 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:09.168989 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:09.288988 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:09.297214 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ffd5068a-4a56-457a-9c15-d5f34254813d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1143 microversion: 2.1 time: 0.147833 Nov 13 07:56:09.297871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 579/1130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:09 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1143 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:10.320797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:10.321564 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:10.330432 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:10.331386 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:10.332476 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:10.333057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:10.452904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:10.460827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7fbfc178-6eb0-4504-b91b-2ae63fdfde3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1191 microversion: 2.1 time: 0.151038 Nov 13 07:56:10.461335 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 552/1131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:10 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1191 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:11.484033 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:11.484763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:11.492195 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:11.492717 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:11.493602 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:11.494111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:11.622881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:11.630930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-173f61ad-d186-4ec3-a3bd-6763590bf682 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1209 microversion: 2.1 time: 0.156764 Nov 13 07:56:11.631505 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 580/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:11 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:12.653546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:12.654146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:12.661321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:12.661765 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:12.662529 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:12.663034 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:13.201000 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:13.209265 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a547e604-e9e3-4a79-9e11-9a33dff2368b tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1276 microversion: 2.1 time: 0.564890 Nov 13 07:56:13.209806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 553/1133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:12 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1276 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:13.322991 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-3e753cca-8fe7-48d8-9c58-6e86f103c609 req-a64dfd11-0cf2-4a36-9c23-311049787bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329a09c-7b94-4db9-ad2b-983f32679a16", "tag": "00bf4560-0c68-451f-b4c9-21a127944ab3"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:13.330072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:56:13.330072 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:56:13.340189 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-3e753cca-8fe7-48d8-9c58-6e86f103c609 req-a64dfd11-0cf2-4a36-9c23-311049787bf8 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:13.340661 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-3e753cca-8fe7-48d8-9c58-6e86f103c609 req-a64dfd11-0cf2-4a36-9c23-311049787bf8 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:13.357474 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-3e753cca-8fe7-48d8-9c58-6e86f103c609 req-a64dfd11-0cf2-4a36-9c23-311049787bf8 service nova] Creating event network-changed:00bf4560-0c68-451f-b4c9-21a127944ab3 for instance 9329a09c-7b94-4db9-ad2b-983f32679a16 on hv-cinder-81783 Nov 13 07:56:13.362422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-3e753cca-8fe7-48d8-9c58-6e86f103c609 req-a64dfd11-0cf2-4a36-9c23-311049787bf8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048426 Nov 13 07:56:13.363045 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 581/1134] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:56:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:56:14.232033 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:14.233213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:14.241110 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:14.241468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:14.242364 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:14.243128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:14.466859 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:14.474902 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6393ba51-74ee-430f-afa8-407bb810aac2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.253407 Nov 13 07:56:14.484904 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 554/1135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:14 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:15.498269 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:15.498986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:15.506450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:15.506927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:15.507691 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:15.508121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:15.778811 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:15.786778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b85b049c-7e59-4418-a5b2-42f189b76508 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.298168 Nov 13 07:56:15.787305 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 582/1136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:15 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:16.811087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:16.811087 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:16.816930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:16.817430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:16.818216 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:16.818653 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:17.024141 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:17.032323 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e499f934-c8aa-4868-b5a6-a50ebbb94807 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.232931 Nov 13 07:56:17.032852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 555/1137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:16 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:18.053257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:18.053858 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:18.061071 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:18.061517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:18.062283 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:18.062738 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:18.266127 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:18.274521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9b8f58c9-67a0-4081-aca2-a63f0bae9087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.230223 Nov 13 07:56:18.275100 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 583/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:18 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:19.296350 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:19.296967 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:19.304279 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:19.304728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:19.305498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:19.305930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:19.510228 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:19.518940 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7a2afd33-33f2-4def-806a-3fe2ef00fe3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.231704 Nov 13 07:56:19.519472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 556/1139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:19 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:20.541838 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:20.542448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:20.549794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:20.550243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:20.551048 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:20.551482 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:20.758916 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:20.766890 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6247aec3-b0b1-4919-ab5d-533d1fbc4577 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.234590 Nov 13 07:56:20.767403 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 584/1140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:20 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:21.787911 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:21.788608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:21.796199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:21.796645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:21.797525 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:21.797958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:22.001767 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:22.009998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-dc37533e-8f4b-4a0e-ba02-58735b0aec82 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.231341 Nov 13 07:56:22.010455 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 557/1141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:21 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:23.035080 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:23.035696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:23.043518 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:23.043967 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:23.044743 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:23.045181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:23.257414 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:23.266206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-88d443f1-6dec-472f-9eb3-fb02093548fa tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.243209 Nov 13 07:56:23.266754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 585/1142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:23 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:24.288774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:24.289375 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:24.296750 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:24.297199 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:24.297961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:24.298390 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:24.608514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:24.617015 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28910c2c-f352-400e-9370-24d70c162087 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.337382 Nov 13 07:56:24.617543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 558/1143] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:24 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:24.785239 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-c8fa7c79-4c4b-4b85-90fc-fce6d55ba64c req-9e07ebda-85d4-4b0d-900f-5b094e6f0ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329a09c-7b94-4db9-ad2b-983f32679a16", "name": "network-vif-plugged", "status": "completed", "tag": "00bf4560-0c68-451f-b4c9-21a127944ab3"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:24.791644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:56:24.791644 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:56:24.800166 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c8fa7c79-4c4b-4b85-90fc-fce6d55ba64c req-9e07ebda-85d4-4b0d-900f-5b094e6f0ecd service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:24.800613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c8fa7c79-4c4b-4b85-90fc-fce6d55ba64c req-9e07ebda-85d4-4b0d-900f-5b094e6f0ecd service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:24.816710 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-c8fa7c79-4c4b-4b85-90fc-fce6d55ba64c req-9e07ebda-85d4-4b0d-900f-5b094e6f0ecd service nova] Creating event network-vif-plugged:00bf4560-0c68-451f-b4c9-21a127944ab3 for instance 9329a09c-7b94-4db9-ad2b-983f32679a16 on hv-cinder-81783 Nov 13 07:56:24.821367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-c8fa7c79-4c4b-4b85-90fc-fce6d55ba64c req-9e07ebda-85d4-4b0d-900f-5b094e6f0ecd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045338 Nov 13 07:56:24.821945 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 586/1144] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:56:25.639102 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:25.639702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:25.646771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:25.647214 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:25.647977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:25.648405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:25.852660 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:25.861359 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-562231fe-61a1-48a0-9ca6-69e5a07a1a34 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1264 microversion: 2.1 time: 0.232027 Nov 13 07:56:25.861881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 559/1145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:25 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:26.884181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:26.884879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:26.893129 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:26.893511 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:26.894274 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:26.894757 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:27.114290 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:27.122726 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-563230c4-97df-4c66-861c-701b43baef3d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1451 microversion: 2.1 time: 0.248235 Nov 13 07:56:27.123344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 587/1146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:26 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:27.144752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:27.145379 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:27.153266 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:27.153712 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:27.154583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:27.155041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:27.365458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:27.373706 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e7dca449-2e13-41e2-80b7-095fdf236ae2 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1451 microversion: 2.1 time: 0.238809 Nov 13 07:56:27.374240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 560/1147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:27 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1451 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:30.537535 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-937cf94b-e1fe-4906-a8d2-695e9a4d6983 req-c5b71742-611b-4cb2-879b-8789c1c127ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329a09c-7b94-4db9-ad2b-983f32679a16", "tag": "00bf4560-0c68-451f-b4c9-21a127944ab3"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:30.545259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:56:30.545259 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:56:30.554011 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-937cf94b-e1fe-4906-a8d2-695e9a4d6983 req-c5b71742-611b-4cb2-879b-8789c1c127ef service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:30.554637 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-937cf94b-e1fe-4906-a8d2-695e9a4d6983 req-c5b71742-611b-4cb2-879b-8789c1c127ef service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:30.591635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-937cf94b-e1fe-4906-a8d2-695e9a4d6983 req-c5b71742-611b-4cb2-879b-8789c1c127ef service nova] Creating event network-changed:00bf4560-0c68-451f-b4c9-21a127944ab3 for instance 9329a09c-7b94-4db9-ad2b-983f32679a16 on hv-cinder-81783 Nov 13 07:56:30.598120 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-937cf94b-e1fe-4906-a8d2-695e9a4d6983 req-c5b71742-611b-4cb2-879b-8789c1c127ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069177 Nov 13 07:56:30.600257 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 588/1148] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:56:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:56:42.067138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:42.068041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:42.075210 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.075656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.076421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.076853 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.144919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3f84b786-bbfc-4524-aafb-8fb9d77cce87 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.088000 Nov 13 07:56:42.145458 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 561/1149] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Nov 13 07:56:42 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:56:42.252541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:42.253102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:42.260711 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.261154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.261931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.262368 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.330881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Going to try to terminate instance {{(pid=97388) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:56:42.658685 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-638a6f0a-ad9f-4488-a6b3-f52fcd8437cf tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 204 len: 0 microversion: 2.20 time: 0.417096 Nov 13 07:56:42.659384 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 589/1150] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Nov 13 07:56:42 2021] DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 13 07:56:42.673502 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:42.673848 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:42.681004 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.681455 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.682762 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:42.683198 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:42.903560 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:42.919867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:42.927352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:42.928884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b9ce23eb-2868-49c0-99bc-c9ef4f5e64c4 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.265214 Nov 13 07:56:42.930273 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 562/1151] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:42 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:43.955962 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:43.956567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:43.964351 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:43.964786 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:43.965575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:43.966002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:44.169762 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:44.184125 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:44.190385 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:44.191485 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-38558808-8a35-4d74-ba59-9b3df6836bc9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1719 microversion: 2.20 time: 0.245822 Nov 13 07:56:44.191999 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 590/1152] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:43 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:45.215472 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:45.216211 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:45.223430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:45.223881 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:45.224654 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:45.225088 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:45.357884 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:45.371828 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:45.378065 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b66c11f533f645e7b610164a5168c34e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f490cae0b0bc42e9967df5c301d2299b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:56:45.379193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cac21c1a-2b5c-429d-8f36-165b1ace37b8 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 200 len: 1652 microversion: 2.20 time: 0.173642 Nov 13 07:56:45.379736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 563/1153] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:45 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 1652 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 13 07:56:45.672517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-a24a230c-d7a9-4029-8b49-4c6f216d93e2 req-e5b609c3-dae0-4bf4-856a-a74dcd7aed77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954e146-2a5c-49d8-a17d-a8299e2a3aed", "name": "network-vif-deleted", "tag": "020633ea-1a2e-4d3a-b46d-9384d4bec624"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:45.678984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:56:45.678984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:56:45.687649 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a24a230c-d7a9-4029-8b49-4c6f216d93e2 req-e5b609c3-dae0-4bf4-856a-a74dcd7aed77 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:45.688084 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a24a230c-d7a9-4029-8b49-4c6f216d93e2 req-e5b609c3-dae0-4bf4-856a-a74dcd7aed77 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:45.703879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-a24a230c-d7a9-4029-8b49-4c6f216d93e2 req-e5b609c3-dae0-4bf4-856a-a74dcd7aed77 service nova] Creating event network-vif-deleted:020633ea-1a2e-4d3a-b46d-9384d4bec624 for instance b954e146-2a5c-49d8-a17d-a8299e2a3aed on hv-cinder-81783 Nov 13 07:56:45.708740 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-a24a230c-d7a9-4029-8b49-4c6f216d93e2 req-e5b609c3-dae0-4bf4-856a-a74dcd7aed77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045858 Nov 13 07:56:45.709610 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 591/1154] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:56:46.403134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:46.403752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:46.411041 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:46.411489 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:46.412300 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:46.412736 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:46.462402 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. Nov 13 07:56:46.463054 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:46.463879 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-71c7f7be-9551-4acf-ab24-84a9b60ea978 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 404 len: 111 microversion: 2.20 time: 0.070401 Nov 13 07:56:46.464615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 564/1155] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Nov 13 07:56:46 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 13 07:56:46.479086 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-68b307f7-c143-44ba-b568-0d989f17e458 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '.version_select at 0x7f54efc59a60>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:46.558422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-68b307f7-c143-44ba-b568-0d989f17e458 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300207155" status: 204 len: 0 microversion: 2.20 time: 0.089099 Nov 13 07:56:46.560164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 592/1156] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Nov 13 07:56:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300207155 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 13 07:56:50.211852 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:50.212334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:50.215707 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8936e76-14f3-4fd0-a22d-5a4751fc8615] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 13 07:56:50.220948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:50.221751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:50.222155 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:50.222589 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:50.272129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. Nov 13 07:56:50.272721 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:50.273530 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-78efad9e-4e6a-4fff-803b-911d0d26f687 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 404 len: 111 microversion: 2.1 time: 0.071050 Nov 13 07:56:50.274050 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 565/1157] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:56:50 2021] DELETE /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:50.287731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:50.288444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: b954e146-2a5c-49d8-a17d-a8299e2a3aed] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:50.296420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:50.296860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:50.297623 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:50.298046 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:50.349204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. Nov 13 07:56:50.349792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance b954e146-2a5c-49d8-a17d-a8299e2a3aed could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:50.350599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d17b01bd-a607-4cf2-affb-f186ecd477ed tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed" status: 404 len: 111 microversion: 2.1 time: 0.072394 Nov 13 07:56:50.351144 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 593/1158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:50 2021] GET /compute/v2.1/servers/b954e146-2a5c-49d8-a17d-a8299e2a3aed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:51.703433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:51.703963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:51.721353 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:51.721800 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:51.722570 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:51.723029 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:51.756417 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8936e76-14f3-4fd0-a22d-5a4751fc8615] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 50478. Nov 13 07:56:51.772783 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. Nov 13 07:56:51.773369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:51.774177 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1e3bd0bd-aa06-462f-a84b-d06fed737a4b tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 404 len: 111 microversion: 2.1 time: 0.079986 Nov 13 07:56:51.774716 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 566/1159] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:56:51 2021] DELETE /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:51.787978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:56:51.788578 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] [instance: 10558cad-5f50-40b7-b4e0-367f83693f74] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:56:51.796091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:51.796535 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:51.797326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:56:51.797756 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:56:51.846383 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] HTTP exception thrown: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. Nov 13 07:56:51.846919 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] Returning 404 to user: Instance 10558cad-5f50-40b7-b4e0-367f83693f74 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:51.847720 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-440d7f2d-0b76-4bbc-b5ed-0c6ad63dc6d9 tempest-AttachVolumeShelveTestJSON-1508683234 tempest-AttachVolumeShelveTestJSON-1508683234-project] 10.222.0.32 "GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74" status: 404 len: 111 microversion: 2.1 time: 0.068843 Nov 13 07:56:51.848230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 594/1160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:56:51 2021] GET /compute/v2.1/servers/10558cad-5f50-40b7-b4e0-367f83693f74 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:56:59.974169 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-70ff4865-fee6-40eb-b12f-d34a7216ba22 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Action: 'create', calling method: .version_select at 0x7f54efccc670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1866375182", "metadata": {"Type": "work"}}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:59.975655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-70ff4865-fee6-40eb-b12f-d34a7216ba22 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:59.976440 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-70ff4865-fee6-40eb-b12f-d34a7216ba22 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149154 Nov 13 07:56:59.976963 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 567/1161] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Nov 13 07:56:59 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 13 07:56:59.992128 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b92a0a7e-1cef-40c3-a2ec-22d620c55968 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Action: 'create', calling method: .version_select at 0x7f54efc594c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-163633435", "metadata": {"Type": "work"}}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:56:59.993544 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-b92a0a7e-1cef-40c3-a2ec-22d620c55968 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:56:59.994332 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-b92a0a7e-1cef-40c3-a2ec-22d620c55968 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011928 Nov 13 07:56:59.994875 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 595/1162] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Nov 13 07:56:59 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 13 07:57:00.009737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-15df06fe-8310-4d7d-979e-03759e79ddc1 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Action: 'create', calling method: .version_select at 0x7f54efbf63a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-771912485", "metadata": {"Type": "work"}}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:00.010910 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-15df06fe-8310-4d7d-979e-03759e79ddc1 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:00.011694 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-15df06fe-8310-4d7d-979e-03759e79ddc1 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011829 Nov 13 07:57:00.012278 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 568/1163] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Nov 13 07:56:59 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 13 07:57:00.027107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-031d6c77-15e9-457d-969f-b811fd23dc96 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Calling method '.version_select at 0x7f54efa39550>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:00.091422 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-031d6c77-15e9-457d-969f-b811fd23dc96 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] HTTP exception thrown: Volume tempest-invalid-485576050 could not be found. Nov 13 07:57:00.092108 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-031d6c77-15e9-457d-969f-b811fd23dc96 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 404 to user: Volume tempest-invalid-485576050 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:00.092952 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-031d6c77-15e9-457d-969f-b811fd23dc96 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-485576050" status: 404 len: 98 microversion: 2.1 time: 0.075745 Nov 13 07:57:00.093592 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 596/1164] 10.222.0.32 () {58 vars in 1214 bytes} [Sat Nov 13 07:57:00 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-485576050 => generated 98 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 13 07:57:00.111597 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-5ed814c9-48f8-4497-9104-ca925543c6e6 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008682 Nov 13 07:57:00.112098 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 569/1165] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Nov 13 07:57:00 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 13 07:57:00.126623 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d92550b6-03b7-4c16-a7d6-edab2ad246b9 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009196 Nov 13 07:57:00.127151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 597/1166] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Nov 13 07:57:00 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 13 07:57:00.141580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cb8fb89b-353c-496a-8e42-b22f4669ef95 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Calling method '.version_select at 0x7f54efbf63a0>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:00.206070 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-cb8fb89b-353c-496a-8e42-b22f4669ef95 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] HTTP exception thrown: Volume 0f464ec4-f35e-4b08-bf83-fc998541276a could not be found. Nov 13 07:57:00.206700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cb8fb89b-353c-496a-8e42-b22f4669ef95 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 404 to user: Volume 0f464ec4-f35e-4b08-bf83-fc998541276a could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:00.207520 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cb8fb89b-353c-496a-8e42-b22f4669ef95 tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/0f464ec4-f35e-4b08-bf83-fc998541276a" status: 404 len: 109 microversion: 2.1 time: 0.075540 Nov 13 07:57:00.208056 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 570/1167] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Nov 13 07:57:00 2021] DELETE /compute/v2.1/os-volumes/0f464ec4-f35e-4b08-bf83-fc998541276a => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:57:00.222588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d29619f7-23db-4065-9fae-bf863e0cca5e tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Calling method '.version_select at 0x7f54efc59820>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:00.292797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-d29619f7-23db-4065-9fae-bf863e0cca5e tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] HTTP exception thrown: Volume 89bd00ec-01fb-41d2-b17c-06b3d9b4e3e1 could not be found. Nov 13 07:57:00.292797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-d29619f7-23db-4065-9fae-bf863e0cca5e tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] Returning 404 to user: Volume 89bd00ec-01fb-41d2-b17c-06b3d9b4e3e1 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:00.292797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-d29619f7-23db-4065-9fae-bf863e0cca5e tempest-VolumesNegativeTest-330805830 tempest-VolumesNegativeTest-330805830-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/89bd00ec-01fb-41d2-b17c-06b3d9b4e3e1" status: 404 len: 109 microversion: 2.1 time: 0.075116 Nov 13 07:57:00.292797 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 598/1168] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Nov 13 07:57:00 2021] GET /compute/v2.1/os-volumes/89bd00ec-01fb-41d2-b17c-06b3d9b4e3e1 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:57:18.829695 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:18.830267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:18.832481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-e1e2db11-a0a6-4b7b-87fb-07d2173e77cb req-a879705b-52fc-40e8-b18b-f2b59e51a6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:18.838339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:18.838833 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:18.839608 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:18.840035 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:18.840248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:18.840248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:18.848873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e1e2db11-a0a6-4b7b-87fb-07d2173e77cb req-a879705b-52fc-40e8-b18b-f2b59e51a6dc service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:18.849475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e1e2db11-a0a6-4b7b-87fb-07d2173e77cb req-a879705b-52fc-40e8-b18b-f2b59e51a6dc service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:18.866105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-e1e2db11-a0a6-4b7b-87fb-07d2173e77cb req-a879705b-52fc-40e8-b18b-f2b59e51a6dc service nova] Creating event network-changed:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:57:18.871636 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-e1e2db11-a0a6-4b7b-87fb-07d2173e77cb req-a879705b-52fc-40e8-b18b-f2b59e51a6dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048690 Nov 13 07:57:18.872311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 599/1169] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:57:18.908987 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:57:19.261371 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fd9b84f0-c67e-46c5-b4f6-f3cf3a9cfb36 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 204 len: 0 microversion: 2.1 time: 0.440835 Nov 13 07:57:19.262952 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 571/1170] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:57:18 2021] DELETE /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:57:19.277411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:19.278480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:19.287635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:19.288516 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:19.290828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:19.294027 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:19.674026 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:19.688588 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0646d841-3f20-4cb3-8e8d-7c6e9a0a4766 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1568 microversion: 2.1 time: 0.420874 Nov 13 07:57:19.689420 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 600/1171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:19 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:20.713445 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:20.714381 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:20.723823 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:20.724277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:20.725061 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:20.725499 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:21.085124 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:21.093768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9e8e0d5b-604e-40bb-a49d-62fae9b3d0ba tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1449 microversion: 2.1 time: 0.390873 Nov 13 07:57:21.094512 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 572/1172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:20 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1449 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:57:21.869827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-32ab7d35-c26e-4e01-953a-90c0d82ee34b req-955405e7-6b88-4e36-9704-1103be832903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba61d7f-793d-4a27-8c7d-11b9dd2b8908", "name": "network-vif-deleted", "tag": "042b7473-49b5-44dd-8697-4c7c9af86227"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:21.876315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:21.876315 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:21.884905 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-32ab7d35-c26e-4e01-953a-90c0d82ee34b req-955405e7-6b88-4e36-9704-1103be832903 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:21.885357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-32ab7d35-c26e-4e01-953a-90c0d82ee34b req-955405e7-6b88-4e36-9704-1103be832903 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:21.901002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-32ab7d35-c26e-4e01-953a-90c0d82ee34b req-955405e7-6b88-4e36-9704-1103be832903 service nova] Creating event network-vif-deleted:042b7473-49b5-44dd-8697-4c7c9af86227 for instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 on hv-cinder-81783 Nov 13 07:57:21.905706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-32ab7d35-c26e-4e01-953a-90c0d82ee34b req-955405e7-6b88-4e36-9704-1103be832903 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046196 Nov 13 07:57:21.906336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 601/1173] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:57:22.117049 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:22.118105 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:22.127135 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:22.131036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:22.131036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:22.131036 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:22.319701 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:22.327649 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-404bda2b-d3a6-42b9-a596-c882e58ccf2e tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1219 microversion: 2.1 time: 0.220329 Nov 13 07:57:22.328184 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 573/1174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:22 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1219 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:23.351452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:23.352158 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:23.359566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:23.360017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:23.361055 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:23.361491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:23.442879 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:23.443327 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:23.443768 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.objects.instance [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lazy-loading 'fault' on Instance uuid 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 {{(pid=97388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:57:23.505228 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dd1924a1214e82984cbfcf7fe39f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4e1d8ace6b4f22816be1ee49b861bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:23.513355 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9bb7152c-80c1-496d-a597-379ce45ffbaf tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 200 len: 1178 microversion: 2.1 time: 0.172100 Nov 13 07:57:23.513884 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 602/1175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:23 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 1178 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:24.536477 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:24.537213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] [instance: 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:24.545384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:24.548384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:24.548384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:24.548384 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:24.605615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] HTTP exception thrown: Instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 could not be found. Nov 13 07:57:24.606282 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Returning 404 to user: Instance 3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:24.607179 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6ff2699a-67d5-48da-80f2-59c3650d125f tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908" status: 404 len: 111 microversion: 2.1 time: 0.080831 Nov 13 07:57:24.607718 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 574/1176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:24 2021] GET /compute/v2.1/servers/3ba61d7f-793d-4a27-8c7d-11b9dd2b8908 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:57:24.966678 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-55bccc16-21cf-4d75-bf3b-8b4dccd14f09 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] Calling method '.version_select at 0x7f54efc59a60>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:25.047538 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-55bccc16-21cf-4d75-bf3b-8b4dccd14f09 tempest-TestShelveInstance-1931356607 tempest-TestShelveInstance-1931356607-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1192690175" status: 202 len: 0 microversion: 2.1 time: 0.090564 Nov 13 07:57:25.048107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 603/1177] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Nov 13 07:57:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1192690175 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 13 07:57:33.337575 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-422422805", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "8492081b-92c5-43bc-bbe2-8278155310cb"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:33.409550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] validate_networks() for [('8492081b-92c5-43bc-bbe2-8278155310cb', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:57:33.989057 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:57:33.989487 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:57:33.989966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:57:33.990450 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:57:33.990917 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:57:34.000023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:34.000442 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:34.001245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:34.001688 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:34.019251 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Getting quotas for project 5aff34cf0d36478d9ca6bc46e4d9ee9a. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:57:34.024002 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Getting quotas for user 7beb1fb830ce4bf5aafe636c982a26c2 and project 5aff34cf0d36478d9ca6bc46e4d9ee9a. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:57:34.034799 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:57:34.037095 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:57:34.161966 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-66228a16-fa7c-4024-9ca7-511978b58b0a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835071 Nov 13 07:57:34.162787 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 575/1178] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:57:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:57:34.178208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9c128bdd-7b6f-40c7-981c-130078d1cd3f tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:34.178867 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9c128bdd-7b6f-40c7-981c-130078d1cd3f tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:34.271082 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9c128bdd-7b6f-40c7-981c-130078d1cd3f tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:34.279063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9c128bdd-7b6f-40c7-981c-130078d1cd3f tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1213 microversion: 2.1 time: 0.109876 Nov 13 07:57:34.279810 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 604/1179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:34 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:35.301670 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:35.305504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:35.310171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:35.310615 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:35.311450 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:35.311890 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:35.440759 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:35.449751 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a9108c09-2efe-452b-9ef8-3c10b73b4647 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1217 microversion: 2.1 time: 0.157465 Nov 13 07:57:35.450902 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 576/1180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:35 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:57:36.473025 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:36.474281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:36.482242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:36.482927 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:36.483910 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:36.484501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:36.617860 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:36.625881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c6342d2d-e4ff-4a4a-b49d-8ea3418960ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1273 microversion: 2.1 time: 0.161902 Nov 13 07:57:36.626408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 605/1181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:36 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:57:37.655457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:37.656075 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:37.663255 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:37.664030 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:37.664509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:37.664943 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:38.137352 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:38.145236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-60d72448-0524-44b5-b95a-0e97805f9190 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.499731 Nov 13 07:57:38.145960 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 577/1182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:37 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:39.044773 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-50db2b35-47aa-49ef-b81e-958bab9a5ced req-f42dc471-357e-41af-a55a-0ea081e9d9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985c0984-1bc7-40f5-b49e-52b2b50914c2", "tag": "229948a2-34e1-4d37-8fdf-648a0fbad2b1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:39.051533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:39.051533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:39.060096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-50db2b35-47aa-49ef-b81e-958bab9a5ced req-f42dc471-357e-41af-a55a-0ea081e9d9e3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:39.060537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-50db2b35-47aa-49ef-b81e-958bab9a5ced req-f42dc471-357e-41af-a55a-0ea081e9d9e3 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:39.076344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-50db2b35-47aa-49ef-b81e-958bab9a5ced req-f42dc471-357e-41af-a55a-0ea081e9d9e3 service nova] Creating event network-changed:229948a2-34e1-4d37-8fdf-648a0fbad2b1 for instance 985c0984-1bc7-40f5-b49e-52b2b50914c2 on hv-cinder-81783 Nov 13 07:57:39.080966 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-50db2b35-47aa-49ef-b81e-958bab9a5ced req-f42dc471-357e-41af-a55a-0ea081e9d9e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046534 Nov 13 07:57:39.081776 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 606/1183] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:57:39.168911 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:39.170337 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:39.180062 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:39.180546 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:39.181489 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:39.181927 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:39.557916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:39.568769 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-cbdfb738-42bf-4af1-a78b-2711c592618c tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.409194 Nov 13 07:57:39.569328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 578/1184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:39 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:40.591976 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:40.592674 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:40.600160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:40.600613 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:40.602007 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:40.602444 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:40.881971 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:40.890601 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-76b5b1a9-124c-45fc-b8cb-c30b280cc307 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.308892 Nov 13 07:57:40.891232 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 607/1185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:40 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:41.914246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:41.914802 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:41.921970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:41.922415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:41.923247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:41.923679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:42.215429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:42.223410 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c8e7672e-f38a-48a3-905b-0f92716b2894 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.318980 Nov 13 07:57:42.223929 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 579/1186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:41 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:43.247311 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:43.248754 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:43.256894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:43.257947 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:43.258872 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:43.259367 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:43.468491 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:43.477567 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-97b06329-d5d2-4f6c-bea1-3a2b112d4354 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.240037 Nov 13 07:57:43.478081 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 608/1187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:43 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:44.499742 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:44.500383 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:44.507514 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:44.507961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:44.508728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:44.509159 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:44.707860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:44.716435 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c4a74dca-c0d3-44a0-9d71-0e93fc520ff3 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.225788 Nov 13 07:57:44.716968 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 580/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:44 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:57:45.321281 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-046ec541-f0b7-491a-9920-dd07f7ac8282 req-00c51ca2-92e2-4352-95b2-f879023ef592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c0984-1bc7-40f5-b49e-52b2b50914c2", "name": "network-vif-plugged", "status": "completed", "tag": "229948a2-34e1-4d37-8fdf-648a0fbad2b1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:45.327573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:45.327573 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:45.335912 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-046ec541-f0b7-491a-9920-dd07f7ac8282 req-00c51ca2-92e2-4352-95b2-f879023ef592 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:45.336349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-046ec541-f0b7-491a-9920-dd07f7ac8282 req-00c51ca2-92e2-4352-95b2-f879023ef592 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:45.351536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-046ec541-f0b7-491a-9920-dd07f7ac8282 req-00c51ca2-92e2-4352-95b2-f879023ef592 service nova] Creating event network-vif-plugged:229948a2-34e1-4d37-8fdf-648a0fbad2b1 for instance 985c0984-1bc7-40f5-b49e-52b2b50914c2 on hv-cinder-81783 Nov 13 07:57:45.356178 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-046ec541-f0b7-491a-9920-dd07f7ac8282 req-00c51ca2-92e2-4352-95b2-f879023ef592 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044106 Nov 13 07:57:45.356727 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 609/1189] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:57:45.738929 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:45.739568 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:45.747363 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:45.747821 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:45.748595 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:45.749028 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:45.943191 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:45.951032 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-121ef7b1-3b3a-483b-aa32-67cc6e6c0aeb tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1313 microversion: 2.1 time: 0.221586 Nov 13 07:57:45.951553 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 581/1190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:45 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:46.974536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:46.976398 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:46.983986 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:46.984430 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:46.985231 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:46.985925 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:47.190242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:47.198206 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-eded47fa-ee9c-4212-90e2-606fc84d962a tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1497 microversion: 2.1 time: 0.233545 Nov 13 07:57:47.198748 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 610/1191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:46 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:48.194891 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:48.195401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:48.202484 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:48.202964 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:48.203761 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:48.204193 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:48.271807 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:57:48.537081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-68b087b1-cfde-4265-ac36-302d6feee2f6 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "DELETE /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 204 len: 0 microversion: 2.1 time: 0.351155 Nov 13 07:57:48.537659 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 582/1192] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:57:48 2021] DELETE /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:57:48.551742 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:48.552350 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:48.560036 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:48.560489 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:48.561331 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:48.561765 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:48.767866 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:48.776372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0a5baf78-37c8-4150-aa0c-b927ec920cdc tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1503 microversion: 2.1 time: 0.234203 Nov 13 07:57:48.776883 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 611/1193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:48 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:49.800941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:49.801645 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:49.809527 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:49.809980 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:49.810784 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:49.811221 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:50.120504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:50.128979 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-2f77d51f-ec22-44dc-b4a4-35e5545988e5 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1503 microversion: 2.1 time: 0.337468 Nov 13 07:57:50.129463 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 583/1194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:49 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1503 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:50.781333 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ccc4c280-3ecf-4324-a3d8-cb5bcf4590ee req-9a1ffe5b-b2eb-4ea2-b20c-4caebddc0381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c0984-1bc7-40f5-b49e-52b2b50914c2", "name": "network-vif-deleted", "tag": "229948a2-34e1-4d37-8fdf-648a0fbad2b1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:50.787892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:50.787892 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:50.796596 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ccc4c280-3ecf-4324-a3d8-cb5bcf4590ee req-9a1ffe5b-b2eb-4ea2-b20c-4caebddc0381 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:50.797172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ccc4c280-3ecf-4324-a3d8-cb5bcf4590ee req-9a1ffe5b-b2eb-4ea2-b20c-4caebddc0381 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:50.813091 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ccc4c280-3ecf-4324-a3d8-cb5bcf4590ee req-9a1ffe5b-b2eb-4ea2-b20c-4caebddc0381 service nova] Creating event network-vif-deleted:229948a2-34e1-4d37-8fdf-648a0fbad2b1 for instance 985c0984-1bc7-40f5-b49e-52b2b50914c2 on hv-cinder-81783 Nov 13 07:57:50.817958 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ccc4c280-3ecf-4324-a3d8-cb5bcf4590ee req-9a1ffe5b-b2eb-4ea2-b20c-4caebddc0381 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046327 Nov 13 07:57:50.818533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 612/1195] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:57:51.151097 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:51.151683 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:51.158723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:51.159170 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:51.159932 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:51.160356 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:51.231133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:51.231580 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:51.232094 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.objects.instance [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lazy-loading 'fault' on Instance uuid 985c0984-1bc7-40f5-b49e-52b2b50914c2 {{(pid=97389) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 13 07:57:51.384498 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:51.392562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1e718c8d-5a5a-4a37-bf9b-4045752f3203 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 200 len: 1303 microversion: 2.1 time: 0.251168 Nov 13 07:57:51.393081 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 584/1196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:51 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 1303 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:52.416063 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:52.416755 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: 985c0984-1bc7-40f5-b49e-52b2b50914c2] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:52.424192 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:52.424635 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:52.425401 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:52.425828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:52.473662 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] HTTP exception thrown: Instance 985c0984-1bc7-40f5-b49e-52b2b50914c2 could not be found. Nov 13 07:57:52.474248 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Returning 404 to user: Instance 985c0984-1bc7-40f5-b49e-52b2b50914c2 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:57:52.475073 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8ce39959-cb72-4498-b4e8-d7abf075b2af tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2" status: 404 len: 111 microversion: 2.1 time: 0.069172 Nov 13 07:57:52.475585 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 613/1197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:52 2021] GET /compute/v2.1/servers/985c0984-1bc7-40f5-b49e-52b2b50914c2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:57:52.584704 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-255601863", "imageRef": "45025720-44cd-432d-b19c-b19b96cc8d74", "flavorRef": "452", "networks": [{"uuid": "8492081b-92c5-43bc-bbe2-8278155310cb"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:52.657604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] validate_networks() for [('8492081b-92c5-43bc-bbe2-8278155310cb', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:57:53.204136 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:57:53.204559 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:57:53.205030 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:57:53.205438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:57:53.205849 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:57:53.214482 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:53.214949 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:53.215776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:53.216236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:53.233827 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Getting quotas for project 5aff34cf0d36478d9ca6bc46e4d9ee9a. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:57:53.237971 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Getting quotas for user 7beb1fb830ce4bf5aafe636c982a26c2 and project 5aff34cf0d36478d9ca6bc46e4d9ee9a. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:57:53.248729 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:57:53.251021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45025720-44cd-432d-b19c-b19b96cc8d74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:57:53.406887 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1e525825-03d0-4b0d-8776-2f23a8e3cc81 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831255 Nov 13 07:57:53.407517 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 585/1198] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:57:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:57:53.423721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-dbb548bb-1de5-4013-a918-469c767c5bbe tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:53.424330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-dbb548bb-1de5-4013-a918-469c767c5bbe tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:53.502506 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-dbb548bb-1de5-4013-a918-469c767c5bbe tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:53.509878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-dbb548bb-1de5-4013-a918-469c767c5bbe tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1213 microversion: 2.1 time: 0.096287 Nov 13 07:57:53.510498 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 614/1199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:53 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:54.532438 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:54.533138 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:54.540976 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:54.541358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:54.542128 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:54.542562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:54.668304 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:54.676278 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b865bf14-3c73-444c-9ded-a4215ff4f912 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1217 microversion: 2.1 time: 0.153043 Nov 13 07:57:54.676805 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 586/1200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:54 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:57:55.698778 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:55.699357 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:55.707197 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:55.707659 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:55.708442 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:55.708877 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:55.828057 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:55.836599 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-82f73fd9-c46f-42f3-b839-043c66e485ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1271 microversion: 2.1 time: 0.146684 Nov 13 07:57:55.837350 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 615/1201] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:55 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:56.858752 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:56.859361 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:56.866626 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:56.867212 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:56.867982 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:56.868411 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:57.378319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:57.386977 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-77a02a56-0938-4308-bcf1-0a87d336e6ce tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.537503 Nov 13 07:57:57.387506 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 587/1202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:56 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:57.524288 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-da532108-8c88-45a7-ae1f-dc986f5def52 req-115109da-2588-4243-a529-061317284489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9386c05-572e-4f2e-be49-f4db02bb3689", "tag": "a2273794-d951-498c-ac86-dcd85f39efb1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:57:57.530853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:57:57.530853 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:57:57.539558 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-da532108-8c88-45a7-ae1f-dc986f5def52 req-115109da-2588-4243-a529-061317284489 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:57.540003 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-da532108-8c88-45a7-ae1f-dc986f5def52 req-115109da-2588-4243-a529-061317284489 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:57.555721 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-da532108-8c88-45a7-ae1f-dc986f5def52 req-115109da-2588-4243-a529-061317284489 service nova] Creating event network-changed:a2273794-d951-498c-ac86-dcd85f39efb1 for instance d9386c05-572e-4f2e-be49-f4db02bb3689 on hv-cinder-81783 Nov 13 07:57:57.560363 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-da532108-8c88-45a7-ae1f-dc986f5def52 req-115109da-2588-4243-a529-061317284489 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046564 Nov 13 07:57:57.560983 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 616/1203] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:57:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:57:58.408705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:58.409307 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:58.419180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:58.419635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:58.420421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:58.420861 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:58.635775 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:57:58.643739 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c5758d9b-55f3-4c13-812a-0654a83d0821 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.244218 Nov 13 07:57:58.644261 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 588/1204] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:58 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:57:59.667809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:57:59.668502 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:57:59.675886 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:59.676337 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:57:59.677111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:57:59.677544 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:00.070002 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:00.077849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4c30b994-7417-4327-b577-a575647f9077 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.420274 Nov 13 07:58:00.078370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 617/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:57:59 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:01.100478 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:01.101125 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:01.108314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:01.108755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:01.109513 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:01.109939 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:01.315663 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:01.323780 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c5ec8bad-c0c5-4b2d-8113-8bca07447320 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.232429 Nov 13 07:58:01.324309 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 589/1206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:01 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:02.346062 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:02.346718 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:02.353692 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:02.354138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:02.354941 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:02.355369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:02.558779 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:02.566626 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-9875631c-e15c-4137-b6c2-8cdec1fa3d50 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.229932 Nov 13 07:58:02.567198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 618/1207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:02 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:03.409443 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-b9cd0654-1692-4d5e-bbb7-b86e72284ddf req-00dc7e49-8850-4ab0-8335-f9fa79eb9f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9386c05-572e-4f2e-be49-f4db02bb3689", "name": "network-vif-plugged", "status": "completed", "tag": "a2273794-d951-498c-ac86-dcd85f39efb1"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:03.416253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:03.416253 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:58:03.424359 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-b9cd0654-1692-4d5e-bbb7-b86e72284ddf req-00dc7e49-8850-4ab0-8335-f9fa79eb9f28 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:03.424801 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-b9cd0654-1692-4d5e-bbb7-b86e72284ddf req-00dc7e49-8850-4ab0-8335-f9fa79eb9f28 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:03.440916 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-b9cd0654-1692-4d5e-bbb7-b86e72284ddf req-00dc7e49-8850-4ab0-8335-f9fa79eb9f28 service nova] Creating event network-vif-plugged:a2273794-d951-498c-ac86-dcd85f39efb1 for instance d9386c05-572e-4f2e-be49-f4db02bb3689 on hv-cinder-81783 Nov 13 07:58:03.445583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-b9cd0654-1692-4d5e-bbb7-b86e72284ddf req-00dc7e49-8850-4ab0-8335-f9fa79eb9f28 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045305 Nov 13 07:58:03.446143 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 590/1208] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:58:03.589751 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:03.590362 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:03.597480 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:03.597930 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:03.598729 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:03.599181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:03.803452 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:03.812240 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ae257195-d238-4afa-ac30-73ec245aa614 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.231752 Nov 13 07:58:03.812767 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 619/1209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:03 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:04.835535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:04.836146 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:04.844726 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:04.845171 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:04.845941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:04.846369 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:05.134353 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:05.142358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-84320f6b-0c9a-40f9-8ba8-05dd8e0c1107 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1313 microversion: 2.1 time: 0.316920 Nov 13 07:58:05.142909 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 591/1210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:04 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:06.165198 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:06.165809 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:06.173105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:06.173547 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:06.174316 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:06.174769 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:06.379790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:06.387785 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-447aeaca-761b-422f-a975-1fbd5a7a444b tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1497 microversion: 2.1 time: 0.232377 Nov 13 07:58:06.388304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 620/1211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:06 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:07.621874 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:07.622382 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:07.629672 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:07.630116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:07.630919 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:07.631347 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:07.698252 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:58:08.062074 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-8f5bfc4f-1138-4d8b-9002-b120477932ae tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 204 len: 0 microversion: 2.1 time: 0.449024 Nov 13 07:58:08.062639 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 592/1212] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:58:07 2021] DELETE /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:58:08.076052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:08.076790 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:08.083895 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:08.084339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:08.085107 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:08.085536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:08.284476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:08.292517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-feb08bf5-0ac8-44c8-b5f1-cdf820a30d09 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1503 microversion: 2.1 time: 0.225639 Nov 13 07:58:08.293042 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 621/1213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:08 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:09.316019 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:09.316709 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:09.323908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:09.324349 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:09.325115 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:09.325540 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:09.672635 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:09.681256 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-28117fb6-b9d5-42a4-90ef-5b4187baa5f1 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1503 microversion: 2.1 time: 0.374774 Nov 13 07:58:09.681797 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 593/1214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:09 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:10.429058 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-c2e29636-d0b6-496d-81f5-afff5e9a15fb req-df0c3e21-6d23-4be0-9678-f924956fe42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9386c05-572e-4f2e-be49-f4db02bb3689", "name": "network-vif-deleted", "tag": "a2273794-d951-498c-ac86-dcd85f39efb1"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:10.435369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:10.435369 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:58:10.443455 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c2e29636-d0b6-496d-81f5-afff5e9a15fb req-df0c3e21-6d23-4be0-9678-f924956fe42b service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:10.443845 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-c2e29636-d0b6-496d-81f5-afff5e9a15fb req-df0c3e21-6d23-4be0-9678-f924956fe42b service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:10.459787 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-c2e29636-d0b6-496d-81f5-afff5e9a15fb req-df0c3e21-6d23-4be0-9678-f924956fe42b service nova] Creating event network-vif-deleted:a2273794-d951-498c-ac86-dcd85f39efb1 for instance d9386c05-572e-4f2e-be49-f4db02bb3689 on hv-cinder-81783 Nov 13 07:58:10.464984 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-c2e29636-d0b6-496d-81f5-afff5e9a15fb req-df0c3e21-6d23-4be0-9678-f924956fe42b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045054 Nov 13 07:58:10.465536 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 622/1215] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:58:10.704021 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:10.704574 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:10.711862 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:10.712319 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:10.713097 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:10.713535 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:10.933385 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1fb830ce4bf5aafe636c982a26c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aff34cf0d36478d9ca6bc46e4d9ee9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:10.941893 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-3deecae8-0706-4ced-a674-80778798ef96 tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 200 len: 1298 microversion: 2.1 time: 0.247837 Nov 13 07:58:10.942471 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 594/1216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:10 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 1298 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:58:11.965871 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:11.966568 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] [instance: d9386c05-572e-4f2e-be49-f4db02bb3689] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:11.974201 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:11.974645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:11.975454 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:11.975893 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:12.024928 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] HTTP exception thrown: Instance d9386c05-572e-4f2e-be49-f4db02bb3689 could not be found. Nov 13 07:58:12.025521 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] Returning 404 to user: Instance d9386c05-572e-4f2e-be49-f4db02bb3689 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:58:12.026335 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-909c5fea-0b6a-4cec-a0cc-d675e53a10ab tempest-VolumesActionsTest-329221826 tempest-VolumesActionsTest-329221826-project] 10.222.0.32 "GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689" status: 404 len: 111 microversion: 2.1 time: 0.071022 Nov 13 07:58:12.026894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 623/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:11 2021] GET /compute/v2.1/servers/d9386c05-572e-4f2e-be49-f4db02bb3689 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 07:58:23.035776 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:23.036360 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:23.044981 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:23.045444 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:23.046233 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:23.046685 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:23.116947 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 07:58:23.382401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-0bbd26a0-72bc-44e9-8c37-6b5efc07eae8 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 204 len: 0 microversion: 2.1 time: 0.372936 Nov 13 07:58:23.386430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 595/1218] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 07:58:23 2021] DELETE /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 07:58:23.399390 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:23.400922 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:23.413190 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:23.416022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:23.416022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:23.416022 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:23.677373 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:23.687372 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-2cdc9978-fc0b-4592-8f68-a6747516558d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1576 microversion: 2.1 time: 0.299220 Nov 13 07:58:23.688204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 624/1219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:23 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1576 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:24.711058 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:24.711771 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:24.718948 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:24.719401 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:24.720173 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:24.720601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:24.947022 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:24.955908 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-bb9ea28c-889a-4c34-a214-dd4598d21337 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1576 microversion: 2.1 time: 0.254528 Nov 13 07:58:24.956457 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 596/1220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:24 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:25.981888 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:25.982492 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:25.990247 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:25.990743 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:25.991533 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:25.991960 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:26.189219 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:26.199747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-0fc08ff7-0b3b-4022-a3f3-12e566b48bba tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1509 microversion: 2.1 time: 0.226732 Nov 13 07:58:26.202703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 625/1221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:25 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:26.902342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [req-00107a2d-8d23-4887-825c-83e37d57002b req-8cf715d3-160b-47ef-8eaa-900126354f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329a09c-7b94-4db9-ad2b-983f32679a16", "name": "network-vif-deleted", "tag": "00bf4560-0c68-451f-b4c9-21a127944ab3"}]} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:26.912328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:26.912328 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: warnings.warn(msg) Nov 13 07:58:26.929872 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-00107a2d-8d23-4887-825c-83e37d57002b req-8cf715d3-160b-47ef-8eaa-900126354f9c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:26.930766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [req-00107a2d-8d23-4887-825c-83e37d57002b req-8cf715d3-160b-47ef-8eaa-900126354f9c service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:26.949488 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.compute.server_external_events [req-00107a2d-8d23-4887-825c-83e37d57002b req-8cf715d3-160b-47ef-8eaa-900126354f9c service nova] Creating event network-vif-deleted:00bf4560-0c68-451f-b4c9-21a127944ab3 for instance 9329a09c-7b94-4db9-ad2b-983f32679a16 on hv-cinder-81783 Nov 13 07:58:26.955314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [req-00107a2d-8d23-4887-825c-83e37d57002b req-8cf715d3-160b-47ef-8eaa-900126354f9c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144098 Nov 13 07:58:26.956906 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 597/1222] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:58:27.236503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:27.239434 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:27.257475 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:27.258515 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:27.260590 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:27.262371 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:27.469829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:27.479184 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-06c5ed78-c9a2-4ae8-ade2-8fa3da3c3d17 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 200 len: 1224 microversion: 2.1 time: 0.263145 Nov 13 07:58:27.481518 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 626/1223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:27 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 1224 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:28.503812 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:28.505270 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:28.514339 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:28.515096 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:28.516122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:28.516755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:28.585974 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] HTTP exception thrown: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. Nov 13 07:58:28.586938 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Returning 404 to user: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 07:58:28.587958 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-a61725cb-6879-4db8-9d17-870254d6e65f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 404 len: 111 microversion: 2.1 time: 0.094666 Nov 13 07:58:28.610875 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 598/1224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:28 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 13 07:58:28.715681 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-657728239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-243676093", "security_groups": [{"name": "tempest-secgroup-smoke-630266333"}], "block_device_mapping_v2": [{"uuid": "9c33db47-f3c5-4b88-9aef-4b6dfbe99e01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b18ecf6-b62e-4677-b0e9-18dde6071eff"}]}} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:28.924395 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.network.neutron [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] validate_networks() for [('5b18ecf6-b62e-4677-b0e9-18dde6071eff', None, None, None)] {{(pid=97388) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 07:58:29.683349 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 07:58:29.684208 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image limits 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 07:58:29.684795 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 07:58:29.685215 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image pref 0:0:0 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 07:58:29.685633 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.virt.hardware [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 07:58:29.695597 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:29.696044 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:29.696849 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:29.697285 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:29.717441 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 07:58:29.721828 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.quota [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for user 1ff81de9cef042ef81e2463b48087197 and project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97388) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 07:58:29.838826 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Going to run 1 instances... {{(pid=97388) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 07:58:29.841763 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c33db47-f3c5-4b88-9aef-4b6dfbe99e01',volume_size=None,volume_type=None)] {{(pid=97388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 07:58:30.292931 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 07:58:30.293230 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: Sat Nov 13 07:58:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.32) !!! Nov 13 07:58:30.345706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4da1b7f9-b871-4f6d-8b33-445fa53acd02 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.640462 Nov 13 07:58:30.346798 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 627/1225] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 07:58:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 07:58:30.364858 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ad870433-f9e0-4baf-9a5e-432519b224af tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:30.367090 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ad870433-f9e0-4baf-9a5e-432519b224af tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:30.530941 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ad870433-f9e0-4baf-9a5e-432519b224af tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:30.567690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ad870433-f9e0-4baf-9a5e-432519b224af tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1093 microversion: 2.1 time: 0.214526 Nov 13 07:58:30.569430 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 599/1226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:30 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1093 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:31.599038 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:31.601099 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:31.609603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:31.610102 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:31.611181 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:31.611615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:31.749649 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:31.759163 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-e45a8c7b-5233-4448-a783-85501bfe9be1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1143 microversion: 2.1 time: 0.176688 Nov 13 07:58:31.760010 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 628/1227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:31 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1143 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:32.798949 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:32.804283 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:32.817277 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:32.817679 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:32.818486 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:32.819133 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:33.061638 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:33.073773 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-222fb911-6daf-40ab-b65d-7252820b15f1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1199 microversion: 2.1 time: 0.288601 Nov 13 07:58:33.083416 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 600/1228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:32 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1199 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:34.104525 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:34.105266 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:34.121450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:34.122151 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:34.123034 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:34.123487 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:34.422118 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:34.430971 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-c5fe9484-a0d1-48f5-af6a-cba6e66c4481 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1276 microversion: 2.1 time: 0.343720 Nov 13 07:58:34.431495 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 629/1229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:34 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:58:35.453936 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:35.470702 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:35.484803 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:35.486408 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:35.487493 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:35.488829 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:35.969198 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:35.978556 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1b7ce393-e1d0-4019-8de9-98aa33b2b569 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.533820 Nov 13 07:58:35.979749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 601/1230] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:35 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:36.082261 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-a02b7379-f546-4935-9312-80e308516441 req-16951b50-4585-47a9-977d-37f071390c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f5b6a0-427f-4d5b-aa6b-a560ecd0d646", "tag": "23c18169-c15e-4b3b-b855-2ac854b07342"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:36.094794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:36.094794 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:58:36.105138 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a02b7379-f546-4935-9312-80e308516441 req-16951b50-4585-47a9-977d-37f071390c23 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:36.105591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a02b7379-f546-4935-9312-80e308516441 req-16951b50-4585-47a9-977d-37f071390c23 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:36.124736 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-a02b7379-f546-4935-9312-80e308516441 req-16951b50-4585-47a9-977d-37f071390c23 service nova] Creating event network-changed:23c18169-c15e-4b3b-b855-2ac854b07342 for instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 on hv-cinder-81783 Nov 13 07:58:36.153957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-a02b7379-f546-4935-9312-80e308516441 req-16951b50-4585-47a9-977d-37f071390c23 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088732 Nov 13 07:58:36.154566 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 630/1231] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 07:58:37.001915 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:37.002650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:37.010756 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:37.011213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:37.011997 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:37.012433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:37.358604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:37.368698 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-6c7e5329-a32d-445a-bc9b-46f37d9e3204 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.376052 Nov 13 07:58:37.369249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 602/1232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:36 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 07:58:38.392053 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:38.392645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:38.400194 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:38.400641 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:38.401408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:38.401843 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:38.624015 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:38.632703 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-cf637073-e2a0-41c1-ab57-8edae725cb9e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.250425 Nov 13 07:58:38.633227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 631/1233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:38 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:39.655548 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:39.656159 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:39.663423 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:39.663873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:39.664678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:39.665116 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:39.866165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:39.874139 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-b21d7ec3-0390-4107-a926-3d9164661a0e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.228612 Nov 13 07:58:39.874720 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 603/1234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:39 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:40.897096 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:40.897700 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:40.904815 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:40.905268 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:40.906035 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:40.906467 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:41.107513 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:41.116085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-47ea2f93-f708-4530-96fb-43bc237a657d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.228747 Nov 13 07:58:41.116840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 632/1235] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:40 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:42.138861 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:42.139543 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:42.146636 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:42.147111 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:42.147871 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:42.148301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:42.349695 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:42.357678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-9ac1408b-a3b3-47a3-bd87-d1eed765d305 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.228588 Nov 13 07:58:42.358207 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 604/1236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:42 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:43.381191 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:43.381829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:43.389209 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:43.389665 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:43.390503 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:43.390964 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:43.685532 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:43.695704 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-39a46b51-ec8a-4bed-92bd-2e8c010968da tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.321999 Nov 13 07:58:43.696242 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 633/1237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:43 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:44.717659 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:44.718267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:44.725970 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:44.726420 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:44.727234 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:44.727673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:44.936122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:44.944162 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-963d0cdd-0923-4a5b-82fa-425b760bcf63 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.235558 Nov 13 07:58:44.944698 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 605/1238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:44 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:45.966154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:45.966732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:45.974371 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:45.974878 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:45.975658 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:45.976094 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:46.316450 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:46.324476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-54e36514-4779-40c3-b4d4-2d1fb5190f33 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.367615 Nov 13 07:58:46.325001 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 634/1239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:45 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:47.346504 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:47.347126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:47.354240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:47.354697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:47.355466 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:47.355897 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:47.559549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:47.568338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7202d432-7c24-46a6-be36-7b1aeb186dd3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.230818 Nov 13 07:58:47.579341 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 606/1240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:47 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:47.919500 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-43cc3598-289a-4251-a489-6a49d37221e6 req-6163f89c-a0e8-4b1b-90f7-5d26a857e0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f5b6a0-427f-4d5b-aa6b-a560ecd0d646", "name": "network-vif-plugged", "status": "completed", "tag": "23c18169-c15e-4b3b-b855-2ac854b07342"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:47.925857 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:47.925857 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:58:47.935092 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-43cc3598-289a-4251-a489-6a49d37221e6 req-6163f89c-a0e8-4b1b-90f7-5d26a857e0af service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:47.935526 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-43cc3598-289a-4251-a489-6a49d37221e6 req-6163f89c-a0e8-4b1b-90f7-5d26a857e0af service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:47.950760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-43cc3598-289a-4251-a489-6a49d37221e6 req-6163f89c-a0e8-4b1b-90f7-5d26a857e0af service nova] Creating event network-vif-plugged:23c18169-c15e-4b3b-b855-2ac854b07342 for instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 on hv-cinder-81783 Nov 13 07:58:47.955382 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-43cc3598-289a-4251-a489-6a49d37221e6 req-6163f89c-a0e8-4b1b-90f7-5d26a857e0af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251609 Nov 13 07:58:47.955938 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 635/1241] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 07:58:48.592741 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:48.593342 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:48.600505 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:48.601103 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:48.601690 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:48.602144 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:48.803764 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:48.811820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c6d2cf75-8c64-48c0-b898-455d3453d1d3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1264 microversion: 2.1 time: 0.228984 Nov 13 07:58:48.812365 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 607/1242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:48 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:49.835577 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:49.836200 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:49.843578 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:49.844033 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:49.844808 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:49.845243 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:50.044850 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:50.052882 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-353785e5-5289-4b4e-8c0e-d8865d9f960a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1451 microversion: 2.1 time: 0.227522 Nov 13 07:58:50.053386 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 636/1243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:49 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1451 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:50.074161 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 07:58:50.074786 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 07:58:50.081779 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:50.082222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:50.083023 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:50.083464 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:50.418129 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 07:58:50.426460 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-ad1aa9ce-6ff3-40e8-be68-7e17ea5f4af6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1451 microversion: 2.1 time: 0.361819 Nov 13 07:58:50.427026 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 608/1244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 07:58:50 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1451 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 07:58:53.237758 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-2b3cb5b7-a5ac-4354-b6c1-07a45d9064dc req-9b7ad8c7-ec5d-41e7-8a77-9a33abe04ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f5b6a0-427f-4d5b-aa6b-a560ecd0d646", "tag": "23c18169-c15e-4b3b-b855-2ac854b07342"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 07:58:53.244061 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 07:58:53.244061 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 07:58:53.252142 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-2b3cb5b7-a5ac-4354-b6c1-07a45d9064dc req-9b7ad8c7-ec5d-41e7-8a77-9a33abe04ff5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 07:58:53.252530 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-2b3cb5b7-a5ac-4354-b6c1-07a45d9064dc req-9b7ad8c7-ec5d-41e7-8a77-9a33abe04ff5 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 07:58:53.268603 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-2b3cb5b7-a5ac-4354-b6c1-07a45d9064dc req-9b7ad8c7-ec5d-41e7-8a77-9a33abe04ff5 service nova] Creating event network-changed:23c18169-c15e-4b3b-b855-2ac854b07342 for instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 on hv-cinder-81783 Nov 13 07:58:53.274064 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-2b3cb5b7-a5ac-4354-b6c1-07a45d9064dc req-9b7ad8c7-ec5d-41e7-8a77-9a33abe04ff5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127906 Nov 13 07:58:53.274894 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 637/1245] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 07:58:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:00:22.719985 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1124562578", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-243676093", "security_groups": [{"name": "tempest-secgroup-smoke-630266333"}], "block_device_mapping_v2": [{"uuid": "d0c167b5-af34-45e1-b471-2866c6d94fdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b18ecf6-b62e-4677-b0e9-18dde6071eff"}]}} {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:00:22.751429 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8936e76-14f3-4fd0-a22d-5a4751fc8615] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 13 08:00:22.752226 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 08:00:22.752373 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: Sat Nov 13 08:00:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.32) !!! Nov 13 08:00:22.763111 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 08:00:22.763267 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: Sat Nov 13 08:00:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.32) !!! Nov 13 08:00:22.933245 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.network.neutron [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] validate_networks() for [('5b18ecf6-b62e-4677-b0e9-18dde6071eff', None, None, None)] {{(pid=97389) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Nov 13 08:00:23.735723 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Nov 13 08:00:23.736581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image limits 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Nov 13 08:00:23.736953 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Flavor pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Nov 13 08:00:23.737310 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Image pref 0:0:0 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Nov 13 08:00:23.737749 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.virt.hardware [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=97389) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Nov 13 08:00:23.746112 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:23.749627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:23.749627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:23.749627 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:23.776650 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8936e76-14f3-4fd0-a22d-5a4751fc8615] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 51496. Nov 13 08:00:23.778700 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 13 08:00:23.782565 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.quota [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Getting quotas for user 1ff81de9cef042ef81e2463b48087197 and project 223449528a9f41b596ada04fa1f9290d. Resources: {'ram', 'instances', 'cores'} {{(pid=97389) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 13 08:00:23.880806 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Going to run 1 instances... {{(pid=97389) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Nov 13 08:00:23.882961 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0c167b5-af34-45e1-b471-2866c6d94fdb',volume_size=None,volume_type=None)] {{(pid=97389) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Nov 13 08:00:24.288993 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fd3df57d-1fbc-4958-b15f-3646cec72009 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.581199 Nov 13 08:00:24.289604 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 609/1246] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Nov 13 08:00:22 2021] POST /compute/v2.1/servers => generated 405 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 13 08:00:24.316957 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ce579139-3dc5-4f5d-b205-14d31226ed49 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:24.318167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ce579139-3dc5-4f5d-b205-14d31226ed49 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:24.322833 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb431b29-419f-4cfe-b6f3-55c9d0e9c2fe] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 13 08:00:24.323648 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 08:00:24.323774 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: Sat Nov 13 08:00:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 (ip 10.222.0.32) !!! Nov 13 08:00:24.412154 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ce579139-3dc5-4f5d-b205-14d31226ed49 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:24.420537 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ce579139-3dc5-4f5d-b205-14d31226ed49 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1094 microversion: 2.1 time: 0.120628 Nov 13 08:00:24.421071 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 638/1247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:24 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:25.442894 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:25.443433 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:25.451907 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:25.452388 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:25.453167 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:25.453602 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:25.573722 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:25.582086 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-17278a0d-f310-4f7a-9903-b1daabbf56ac tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1136 microversion: 2.1 time: 0.148429 Nov 13 08:00:25.582634 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 610/1248] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:25 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1136 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:26.608167 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:26.608792 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:26.627909 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:26.628370 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:26.629216 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:26.629657 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:26.685402 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb431b29-419f-4cfe-b6f3-55c9d0e9c2fe] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 51520. Nov 13 08:00:26.755494 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:26.764105 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-65c2c0b2-3ab3-4995-b3a9-43920b86c48e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1210 microversion: 2.1 time: 0.166539 Nov 13 08:00:26.764646 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 639/1249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:26 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:27.787236 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:27.787998 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:27.795868 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:27.796391 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:27.797446 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:27.798083 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:28.286705 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:28.295567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fec6f193-9672-4d15-bc23-f808f936c766 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1277 microversion: 2.1 time: 0.517558 Nov 13 08:00:28.296403 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 611/1250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:27 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1277 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 08:00:28.636541 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ab254d5a-e17a-42dd-8393-4b13bc92a134 req-1eeb925c-20f6-46ab-939b-e199d955cbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe26ae7-3892-4f48-a34d-9037b21729c1", "tag": "ddafe876-d58f-4263-ad18-60faff7986cf"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:00:28.643109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:00:28.643109 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:00:28.651478 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ab254d5a-e17a-42dd-8393-4b13bc92a134 req-1eeb925c-20f6-46ab-939b-e199d955cbb7 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:28.651922 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ab254d5a-e17a-42dd-8393-4b13bc92a134 req-1eeb925c-20f6-46ab-939b-e199d955cbb7 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:28.668213 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ab254d5a-e17a-42dd-8393-4b13bc92a134 req-1eeb925c-20f6-46ab-939b-e199d955cbb7 service nova] Creating event network-changed:ddafe876-d58f-4263-ad18-60faff7986cf for instance bfe26ae7-3892-4f48-a34d-9037b21729c1 on hv-cinder-81783 Nov 13 08:00:28.673310 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ab254d5a-e17a-42dd-8393-4b13bc92a134 req-1eeb925c-20f6-46ab-939b-e199d955cbb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046170 Nov 13 08:00:28.677330 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 640/1251] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:00:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:00:29.318437 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:29.319077 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:29.326882 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:29.327334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:29.328113 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:29.328550 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:29.703803 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:29.712843 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-49988a5e-d2bd-459b-bc4f-f3d07cdb59c6 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.403594 Nov 13 08:00:29.713391 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 612/1252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:29 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:30.735341 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:30.736285 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:30.743640 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:30.744580 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:30.745339 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:30.745772 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:30.940834 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:30.949326 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-901f9aef-ace5-41cc-bdb3-db57ec35852d tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.223522 Nov 13 08:00:30.949840 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 641/1253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:30 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:31.972165 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:31.972697 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:31.980134 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:31.987321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:31.987321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:31.987321 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:32.283860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:32.291889 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-7df1b730-9c61-4c1e-9ad2-f1fff1e0005a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.329743 Nov 13 08:00:32.292396 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 613/1254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:31 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:33.313686 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:33.314285 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:33.321468 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:33.322392 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:33.323213 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:33.323645 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:33.523375 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:33.531885 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-51156e80-115e-44cf-81ef-b1edbd0a91ef tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.227288 Nov 13 08:00:33.532411 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 642/1255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:33 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:34.553777 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:34.554380 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:34.561561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:34.562004 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:34.562791 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:34.563222 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:34.765275 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:34.773180 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c8ee114a-727b-47a4-a8f8-a90bc7bcf7a7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.228548 Nov 13 08:00:34.773699 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 614/1256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:34 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:35.887293 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:35.887922 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:35.898519 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:35.899006 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:35.909291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:35.909291 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:36.126619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:36.134501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-6e793fee-3f5c-4512-9ce3-e0d969e0b232 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.347786 Nov 13 08:00:36.135052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 643/1257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:35 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:37.156500 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:37.157092 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:37.164306 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:37.164755 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:37.165532 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:37.165965 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:37.362923 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:37.371562 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f7c8e7f2-1e5d-49ef-9afa-6de79b4f72f7 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.224211 Nov 13 08:00:37.375451 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 615/1258] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:37 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:38.393829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:38.394440 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:38.401576 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:38.402696 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:38.403458 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:38.403889 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:38.611343 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:38.619591 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-ec997a7b-ebd7-494a-8894-ec41f0ffdf56 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.235325 Nov 13 08:00:38.620336 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 644/1259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:38 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:39.642581 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:39.643208 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:39.650297 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:39.650768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:39.651528 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:39.652567 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:39.853930 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:39.862052 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-e91bd7e5-6250-4122-bcef-4b850d41b6fd tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.229077 Nov 13 08:00:39.862566 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 616/1260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:39 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:40.195168 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-a9cb2836-8dc4-4666-a857-ca53ee0d2cc3 req-ba980bd1-000c-44d2-9bdd-52d4a9708c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe26ae7-3892-4f48-a34d-9037b21729c1", "name": "network-vif-plugged", "status": "completed", "tag": "ddafe876-d58f-4263-ad18-60faff7986cf"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:00:40.202077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:00:40.202077 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:00:40.209935 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a9cb2836-8dc4-4666-a857-ca53ee0d2cc3 req-ba980bd1-000c-44d2-9bdd-52d4a9708c58 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:40.210377 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-a9cb2836-8dc4-4666-a857-ca53ee0d2cc3 req-ba980bd1-000c-44d2-9bdd-52d4a9708c58 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:40.225706 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-a9cb2836-8dc4-4666-a857-ca53ee0d2cc3 req-ba980bd1-000c-44d2-9bdd-52d4a9708c58 service nova] Creating event network-vif-plugged:ddafe876-d58f-4263-ad18-60faff7986cf for instance bfe26ae7-3892-4f48-a34d-9037b21729c1 on hv-cinder-81783 Nov 13 08:00:40.230472 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-a9cb2836-8dc4-4666-a857-ca53ee0d2cc3 req-ba980bd1-000c-44d2-9bdd-52d4a9708c58 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 Nov 13 08:00:40.231059 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 645/1261] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:00:40.883983 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:40.884509 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:40.891680 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:40.892122 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:40.892883 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:40.893314 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:41.095257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:41.103240 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-753c6745-7d33-4710-ac24-8f3f7f9f32e3 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1265 microversion: 2.1 time: 0.228510 Nov 13 08:00:41.103754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 617/1262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:40 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:42.126619 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:42.127334 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:42.134900 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:42.135344 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:42.136158 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:42.136586 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:42.333559 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:42.342052 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-87832b45-2e4a-4e7d-a44a-99337f71233a tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1452 microversion: 2.1 time: 0.225532 Nov 13 08:00:42.342555 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 646/1263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:42 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:42.364249 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:00:42.364860 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:00:42.372013 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:42.372468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:42.373239 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:42.373678 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:42.575294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:00:42.583421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-f7122926-35f7-4c75-a3a6-a9dac703e53f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1452 microversion: 2.1 time: 0.229225 Nov 13 08:00:42.583944 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 618/1264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:00:42 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1452 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:00:45.429945 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-ce03bb0a-64ff-489c-9dc2-04cf416567f7 req-8e4441af-e916-40c2-869f-2ad992ff8968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe26ae7-3892-4f48-a34d-9037b21729c1", "tag": "ddafe876-d58f-4263-ad18-60faff7986cf"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:00:45.436164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:00:45.436164 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:00:45.444408 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ce03bb0a-64ff-489c-9dc2-04cf416567f7 req-8e4441af-e916-40c2-869f-2ad992ff8968 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:00:45.444852 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-ce03bb0a-64ff-489c-9dc2-04cf416567f7 req-8e4441af-e916-40c2-869f-2ad992ff8968 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:00:45.460223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-ce03bb0a-64ff-489c-9dc2-04cf416567f7 req-8e4441af-e916-40c2-869f-2ad992ff8968 service nova] Creating event network-changed:ddafe876-d58f-4263-ad18-60faff7986cf for instance bfe26ae7-3892-4f48-a34d-9037b21729c1 on hv-cinder-81783 Nov 13 08:00:45.465476 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-ce03bb0a-64ff-489c-9dc2-04cf416567f7 req-8e4441af-e916-40c2-869f-2ad992ff8968 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045597 Nov 13 08:00:45.466160 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 647/1265] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:00:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:02:08.327223 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:08.327820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:08.329625 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-d2c50558-556b-4b76-b02e-2047217af62e req-1b53f486-b46a-4aa1-bdb5-9e9548c36820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe26ae7-3892-4f48-a34d-9037b21729c1", "tag": "ddafe876-d58f-4263-ad18-60faff7986cf"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:02:08.336204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:02:08.336204 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:02:08.336468 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:08.336673 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:08.337459 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:08.337933 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:08.340604 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 13 08:02:08.347998 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: Sat Nov 13 08:02:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.32) !!! Nov 13 08:02:08.358628 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-d2c50558-556b-4b76-b02e-2047217af62e req-1b53f486-b46a-4aa1-bdb5-9e9548c36820 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:08.359111 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-d2c50558-556b-4b76-b02e-2047217af62e req-1b53f486-b46a-4aa1-bdb5-9e9548c36820 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:08.376446 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-d2c50558-556b-4b76-b02e-2047217af62e req-1b53f486-b46a-4aa1-bdb5-9e9548c36820 service nova] Creating event network-changed:ddafe876-d58f-4263-ad18-60faff7986cf for instance bfe26ae7-3892-4f48-a34d-9037b21729c1 on hv-cinder-81783 Nov 13 08:02:08.381143 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-d2c50558-556b-4b76-b02e-2047217af62e req-1b53f486-b46a-4aa1-bdb5-9e9548c36820 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061429 Nov 13 08:02:08.381731 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 648/1266] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:02:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:02:08.411475 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 08:02:08.817583 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-06d921e0-6b16-4e2b-b6b6-d37efab10f04 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 204 len: 0 microversion: 2.1 time: 0.500276 Nov 13 08:02:08.818656 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 619/1267] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 08:02:08 2021] DELETE /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 08:02:08.835270 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:08.835987 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:08.844781 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:08.849419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:08.849419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:08.849419 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:09.129978 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:09.139150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-1a9b0c93-97c6-414b-b3ad-c329ba75533e tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1577 microversion: 2.1 time: 0.315321 Nov 13 08:02:09.139915 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 649/1268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:08 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1577 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:02:10.162302 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:10.163022 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:10.170294 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:10.170778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:10.171555 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:10.171994 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:10.418257 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:10.426190 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-c56b5ba3-6508-4bcf-ad84-0f22214a4b8f tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1458 microversion: 2.1 time: 0.273446 Nov 13 08:02:10.426737 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 620/1269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:10 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1458 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:02:11.233793 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-e1dacae5-2402-4d00-870b-06d9f4d97755 req-44979dea-ebde-4b84-aa28-63f06b2a65a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe26ae7-3892-4f48-a34d-9037b21729c1", "name": "network-vif-deleted", "tag": "ddafe876-d58f-4263-ad18-60faff7986cf"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:02:11.240304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:02:11.240304 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:02:11.248226 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e1dacae5-2402-4d00-870b-06d9f4d97755 req-44979dea-ebde-4b84-aa28-63f06b2a65a9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:11.248671 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-e1dacae5-2402-4d00-870b-06d9f4d97755 req-44979dea-ebde-4b84-aa28-63f06b2a65a9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:11.264386 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-e1dacae5-2402-4d00-870b-06d9f4d97755 req-44979dea-ebde-4b84-aa28-63f06b2a65a9 service nova] Creating event network-vif-deleted:ddafe876-d58f-4263-ad18-60faff7986cf for instance bfe26ae7-3892-4f48-a34d-9037b21729c1 on hv-cinder-81783 Nov 13 08:02:11.270873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-e1dacae5-2402-4d00-870b-06d9f4d97755 req-44979dea-ebde-4b84-aa28-63f06b2a65a9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044465 Nov 13 08:02:11.270873 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 650/1270] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:02:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:02:11.449358 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:11.449972 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:11.457148 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:11.457952 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:11.458778 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:11.459213 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:11.670421 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:11.683405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-d4bca85a-4026-4d56-a27e-41681c0a2276 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 200 len: 1225 microversion: 2.1 time: 0.238725 Nov 13 08:02:11.683405 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 621/1271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:11 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 1225 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:02:12.702747 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:12.703448 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: bfe26ae7-3892-4f48-a34d-9037b21729c1] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:12.710964 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:12.711416 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:12.712193 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:12.712629 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:12.761643 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] HTTP exception thrown: Instance bfe26ae7-3892-4f48-a34d-9037b21729c1 could not be found. Nov 13 08:02:12.762236 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Returning 404 to user: Instance bfe26ae7-3892-4f48-a34d-9037b21729c1 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 08:02:12.763075 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-4d0eb126-f5b8-4169-a3af-1649cab23e53 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1" status: 404 len: 111 microversion: 2.1 time: 0.070229 Nov 13 08:02:12.763639 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 651/1272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:12 2021] GET /compute/v2.1/servers/bfe26ae7-3892-4f48-a34d-9037b21729c1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 08:02:17.042873 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:17.043453 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:17.045150 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-d34e358d-569f-46ed-aa8a-edd058de9922 req-3e8f5cdb-1b17-4448-a2b0-7f375a8eb4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f5b6a0-427f-4d5b-aa6b-a560ecd0d646", "tag": "23c18169-c15e-4b3b-b855-2ac854b07342"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:02:17.050554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:17.051040 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:17.051820 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:17.051940 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:02:17.051940 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:02:17.052247 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:17.060172 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-d34e358d-569f-46ed-aa8a-edd058de9922 req-3e8f5cdb-1b17-4448-a2b0-7f375a8eb4d7 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:17.060615 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-d34e358d-569f-46ed-aa8a-edd058de9922 req-3e8f5cdb-1b17-4448-a2b0-7f375a8eb4d7 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:17.076881 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-d34e358d-569f-46ed-aa8a-edd058de9922 req-3e8f5cdb-1b17-4448-a2b0-7f375a8eb4d7 service nova] Creating event network-changed:23c18169-c15e-4b3b-b855-2ac854b07342 for instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 on hv-cinder-81783 Nov 13 08:02:17.081656 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-d34e358d-569f-46ed-aa8a-edd058de9922 req-3e8f5cdb-1b17-4448-a2b0-7f375a8eb4d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Nov 13 08:02:17.082217 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 652/1273] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:02:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 13 08:02:17.125754 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Going to try to terminate instance {{(pid=97389) delete /opt/stack/nova/nova/compute/api.py:2559}} Nov 13 08:02:17.491801 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-24c4b582-d7dc-4f10-b705-f9e123f3f6d1 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "DELETE /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 204 len: 0 microversion: 2.1 time: 0.458173 Nov 13 08:02:17.493103 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 622/1274] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 08:02:17 2021] DELETE /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 13 08:02:17.507162 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:17.507859 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:17.516224 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:17.517000 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:17.518049 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:17.518760 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:17.816829 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.policy [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97388) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:17.825121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5b5118a8-fb54-4a9d-944a-3371cf402140 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1576 microversion: 2.1 time: 0.327520 Nov 13 08:02:17.827964 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 653/1275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:17 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1576 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:02:18.848172 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:18.848867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:18.856655 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:18.857100 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:18.857867 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:18.858301 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:19.112766 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:19.120877 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-65531572-d11c-4324-80e1-84e8973dc625 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1457 microversion: 2.1 time: 0.282239 Nov 13 08:02:19.121415 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 623/1276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:18 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1457 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 13 08:02:19.914832 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [req-21d64a36-18bc-4305-b07b-9a3386c1e1ec req-31cbb9aa-7175-4037-9c3f-f35bf49b80a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f5b6a0-427f-4d5b-aa6b-a560ecd0d646", "name": "network-vif-deleted", "tag": "23c18169-c15e-4b3b-b855-2ac854b07342"}]} {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 13 08:02:19.921121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 13 08:02:19.921121 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: warnings.warn(msg) Nov 13 08:02:19.929132 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-21d64a36-18bc-4305-b07b-9a3386c1e1ec req-31cbb9aa-7175-4037-9c3f-f35bf49b80a9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:19.929581 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [req-21d64a36-18bc-4305-b07b-9a3386c1e1ec req-31cbb9aa-7175-4037-9c3f-f35bf49b80a9 service nova] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:19.945312 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.compute.server_external_events [req-21d64a36-18bc-4305-b07b-9a3386c1e1ec req-31cbb9aa-7175-4037-9c3f-f35bf49b80a9 service nova] Creating event network-vif-deleted:23c18169-c15e-4b3b-b855-2ac854b07342 for instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 on hv-cinder-81783 Nov 13 08:02:19.950501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [req-21d64a36-18bc-4305-b07b-9a3386c1e1ec req-31cbb9aa-7175-4037-9c3f-f35bf49b80a9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044780 Nov 13 08:02:19.951098 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 654/1277] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Nov 13 08:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 13 08:02:20.143636 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:20.144246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:20.151684 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:20.152334 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:20.153126 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:20.153554 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:20.373768 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.policy [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff81de9cef042ef81e2463b48087197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223449528a9f41b596ada04fa1f9290d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97389) authorize /opt/stack/nova/nova/policy.py:222}} Nov 13 08:02:20.381869 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-152770a5-630a-42f5-b3e1-3c3886b5ceab tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 200 len: 1224 microversion: 2.1 time: 0.248084 Nov 13 08:02:20.382338 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 624/1278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:20 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 1224 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 13 08:02:21.404827 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:21.405501 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:21.413074 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:21.413517 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:21.414575 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:21.414732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:21.463085 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] HTTP exception thrown: Instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 could not be found. Nov 13 08:02:21.463672 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Returning 404 to user: Instance 61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 08:02:21.464481 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-8c0a3c33-2781-4d6e-b6c9-4892461dac52 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646" status: 404 len: 111 microversion: 2.1 time: 0.069818 Nov 13 08:02:21.465003 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 655/1279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:21 2021] GET /compute/v2.1/servers/61f5b6a0-427f-4d5b-aa6b-a560ecd0d646 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 08:02:22.412295 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:22.412774 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.compute.api [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97389) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:22.420549 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:22.420994 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:22.421798 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:22.422232 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG oslo_concurrency.lockutils [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97389) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:22.470728 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.wsgi [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] HTTP exception thrown: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. Nov 13 08:02:22.471246 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Returning 404 to user: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. {{(pid=97389) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 08:02:22.472042 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-1597170e-3a66-4059-80fc-eae75b5ef43c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 404 len: 111 microversion: 2.1 time: 0.068986 Nov 13 08:02:22.472561 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 625/1280] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Nov 13 08:02:22 2021] DELETE /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 08:02:22.486732 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '>' {{(pid=97388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:22.487345 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.compute.api [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] [instance: 9329a09c-7b94-4db9-ad2b-983f32679a16] Fetching instance by UUID {{(pid=97388) get /opt/stack/nova/nova/compute/api.py:2810}} Nov 13 08:02:22.495017 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:22.495466 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:22.496227 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 13 08:02:22.496663 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG oslo_concurrency.lockutils [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Lock "7b8a17e1-4a8c-41e8-b833-be40a715238f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=97388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 13 08:02:22.544609 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.wsgi [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] HTTP exception thrown: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. Nov 13 08:02:22.545223 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: DEBUG nova.api.openstack.wsgi [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Returning 404 to user: Instance 9329a09c-7b94-4db9-ad2b-983f32679a16 could not be found. {{(pid=97388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Nov 13 08:02:22.546016 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: INFO nova.api.openstack.requestlog [None req-5718c11e-1c47-4656-8f21-514cdcaaf495 tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16" status: 404 len: 111 microversion: 2.1 time: 0.069104 Nov 13 08:02:22.546544 dv-cinder-817832-1-iscsi devstack@n-api.service[97388]: [pid: 97388|app: 0|req: 656/1281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Nov 13 08:02:22 2021] GET /compute/v2.1/servers/9329a09c-7b94-4db9-ad2b-983f32679a16 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 13 08:02:24.277668 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: DEBUG nova.api.openstack.wsgi [None req-fa86125b-7770-4dd6-a153-db4f5fb2631c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] Calling method '.version_select at 0x7f54efbf6550>' {{(pid=97389) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 13 08:02:24.377601 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: INFO nova.api.openstack.requestlog [None req-fa86125b-7770-4dd6-a153-db4f5fb2631c tempest-TestVolumeBootPattern-2000361677 tempest-TestVolumeBootPattern-2000361677-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-243676093" status: 202 len: 0 microversion: 2.1 time: 0.116692 Nov 13 08:02:24.378168 dv-cinder-817832-1-iscsi devstack@n-api.service[97389]: [pid: 97389|app: 0|req: 626/1282] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Nov 13 08:02:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-243676093 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)